[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:14 dist-test-slave-gsp7 krb5kdc[28401](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:14 dist-test-slave-gsp7 krb5kdc[28401](info): set up 2 sockets
Aug 11 16:42:14 dist-test-slave-gsp7 krb5kdc[28401](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 16:42:15.296626 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:15 dist-test-slave-gsp7 krb5kdc[28401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:15.427098 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:32999
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:32999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:15.515720 28416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:15.515995 28416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:15.516038 28416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:15.517234 28416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:15.517438 28416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:15.517565 28416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:15.517591 28416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:15.517613 28416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:15.519447 28416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:32999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:32999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:15.519865 28416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:15.520184 28416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:15.527499 28433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:15.527673 28428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:15.527887 28427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:15.528076 28416 server_base.cc:1034] running on GCE node
I20260811 16:42:15.528301 28416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:15.528723 28416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:15.529870 28416 hybrid_clock.cc:648] HybridClock initialized: now 1786466535529850 us; error 59 us; skew 500 ppm
Aug 11 16:42:15 dist-test-slave-gsp7 krb5kdc[28401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466535, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:15.532636 28416 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:15.533327 28416 webserver.cc:460] Webserver started at http://127.27.186.126:33103/ using document root <none> and password file <none>
I20260811 16:42:15.533679 28416 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:15.533757 28416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:15.533942 28416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:15.535471 28416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "6882ab8f544140eb8a36f5d154f84df3"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "92e2ad7be6a9ccd0ec78cc4f316e401a"
server_key_iv: "2534461b95d9bf31ca2a1086f49e4d57"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.536217 28416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "6882ab8f544140eb8a36f5d154f84df3"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "92e2ad7be6a9ccd0ec78cc4f316e401a"
server_key_iv: "2534461b95d9bf31ca2a1086f49e4d57"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.538097 28416 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260811 16:42:15.539193 28446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:15.539551 28416 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:15.539672 28416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "6882ab8f544140eb8a36f5d154f84df3"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "92e2ad7be6a9ccd0ec78cc4f316e401a"
server_key_iv: "2534461b95d9bf31ca2a1086f49e4d57"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.539789 28416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:15.565733 28416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:15.568081 28416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:15.568289 28416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:15.573295 28416 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:32999
I20260811 16:42:15.573360 28521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:32999 every 8 connection(s)
I20260811 16:42:15.573984 28416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:15.575340 28522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:15.578614 28522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3: Bootstrap starting.
I20260811 16:42:15.579466 28522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:15.580102 28522 log.cc:824] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:15.581014 28522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3: No bootstrap required, opened a new log
I20260811 16:42:15.583904 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28416
I20260811 16:42:15.583992 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:15.584622 28393 external_mini_cluster.cc:1428] Setting key b8c88751cc83e6fac652e6651b446a30
I20260811 16:42:15.584933 28522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6882ab8f544140eb8a36f5d154f84df3" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32999 } }
I20260811 16:42:15.585155 28522 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:15.585256 28522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6882ab8f544140eb8a36f5d154f84df3, State: Initialized, Role: FOLLOWER
I20260811 16:42:15.585472 28522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6882ab8f544140eb8a36f5d154f84df3" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32999 } }
I20260811 16:42:15.585687 28522 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:15.585759 28522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:15.585830 28522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:15.587208 28522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6882ab8f544140eb8a36f5d154f84df3" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32999 } }
I20260811 16:42:15.587440 28522 leader_election.cc:302] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6882ab8f544140eb8a36f5d154f84df3; no voters:
I20260811 16:42:15.587643 28522 leader_election.cc:288] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:15.587694 28531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:15.587939 28531 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [term 1 LEADER]: Becoming Leader. State: Replica: 6882ab8f544140eb8a36f5d154f84df3, State: Running, Role: LEADER
I20260811 16:42:15.588152 28522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:15.588339 28531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6882ab8f544140eb8a36f5d154f84df3" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32999 } }
I20260811 16:42:15.589111 28532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6882ab8f544140eb8a36f5d154f84df3. Latest consensus state: current_term: 1 leader_uuid: "6882ab8f544140eb8a36f5d154f84df3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6882ab8f544140eb8a36f5d154f84df3" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32999 } } }
I20260811 16:42:15.589263 28533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6882ab8f544140eb8a36f5d154f84df3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6882ab8f544140eb8a36f5d154f84df3" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32999 } } }
I20260811 16:42:15.589285 28532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:15.589358 28533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:15.590104 28545 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:15.591542 28545 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:15.593807 28545 catalog_manager.cc:1347] Generated new cluster ID: 53cd94d7fb1a4856a4523d2b682211d3
I20260811 16:42:15.593863 28545 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:42:15 dist-test-slave-gsp7 krb5kdc[28401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:15.607589 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:15.585812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56448 (local address 127.27.186.126:32999)
0811 16:42:15.586163 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:15.586174 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:15.586551 (+ 377us) server_negotiation.cc:407] Connection header received
0811 16:42:15.589329 (+ 2778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:15.589343 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:15.589411 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:15.589567 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:15.593795 (+ 4228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:15.595893 (+ 2098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:15.597473 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:15.598346 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:15.598474 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:15.603090 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:15.603094 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:15.603095 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:15.603115 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:15.605411 (+ 2296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:15.605898 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:15.605901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:15.605902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:15.606008 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:15.606278 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:15.606279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:15.606280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:15.606616 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:15.606841 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:15.607084 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 16:42:15.607265 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":158,"threads_started":1}
I20260811 16:42:15.611013 28545 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:15.611609 28545 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:15.615054 28545 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6882ab8f544140eb8a36f5d154f84df3: Generated new TSK 0
I20260811 16:42:15.615258 28545 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:15.645152 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32999
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:15.732168 28562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:15.732390 28562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:15.732417 28562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:15.733716 28562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:15.733767 28562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:15.733798 28562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:15.735318 28562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:15.735669 28562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:15.735944 28562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:15.741739 28574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:15.741777 28576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:15.741832 28573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:15.742024 28562 server_base.cc:1034] running on GCE node
I20260811 16:42:15.742300 28562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:15.742686 28562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:15.743940 28562 hybrid_clock.cc:648] HybridClock initialized: now 1786466535743918 us; error 48 us; skew 500 ppm
Aug 11 16:42:15 dist-test-slave-gsp7 krb5kdc[28401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466535, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:15.746949 28562 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:15.747483 28562 webserver.cc:460] Webserver started at http://127.27.186.65:42133/ using document root <none> and password file <none>
I20260811 16:42:15.747731 28562 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:15.747776 28562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:15.747902 28562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:15.749050 28562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "d0cb4a1e28a84d689e39d556436879dc"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "95f868d243459713ea159adfbb96f2cc"
server_key_iv: "6db01609dc944c1231b2154b109cc25b"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.749442 28562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "d0cb4a1e28a84d689e39d556436879dc"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "95f868d243459713ea159adfbb96f2cc"
server_key_iv: "6db01609dc944c1231b2154b109cc25b"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.751178 28562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:15.752075 28585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:15.752249 28562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:15.752362 28562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "d0cb4a1e28a84d689e39d556436879dc"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "95f868d243459713ea159adfbb96f2cc"
server_key_iv: "6db01609dc944c1231b2154b109cc25b"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.752437 28562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:15.773037 28562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:15.775863 28562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:15.776084 28562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:15.776554 28562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:15.776970 28562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:15.777057 28562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:15.777083 28562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:15.777096 28562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:15.792613 28562 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:46225
I20260811 16:42:15.792774 28777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:46225 every 8 connection(s)
I20260811 16:42:15.793159 28562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:42:15 dist-test-slave-gsp7 krb5kdc[28401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466535, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:15.801260 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28562
I20260811 16:42:15.801339 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:15.801570 28393 external_mini_cluster.cc:1428] Setting key bfd242f8696fbd39c03fb0f591bcd8e6
I20260811 16:42:15.803445 28782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:15.794164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:32999 (local address 127.27.186.65:40241)
0811 16:42:15.794446 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:15.794484 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:15.795042 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:15.795261 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:15.795265 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:15.795925 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:15.796122 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:15.796128 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:15.796784 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:15.796785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:15.797677 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:15.797679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:15.798023 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:15.798023 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:15.798126 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:15.798694 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:15.798703 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:15.800195 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:15.801982 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:15.801990 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:15.801992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:15.802286 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:15.802516 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:15.802516 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:15.802517 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:15.802615 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:15.802917 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:15.802922 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:15.803036 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 16:42:15.803119 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:42:15.803235 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":212,"threads_started":1}
I20260811 16:42:15.803493 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:15.794208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:40241 (local address 127.27.186.126:32999)
0811 16:42:15.794262 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:15.794264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:15.794579 (+ 315us) server_negotiation.cc:407] Connection header received
0811 16:42:15.795138 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:15.795139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:15.795149 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:15.795203 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:15.796204 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:15.796704 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:15.797753 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:15.797952 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:15.798004 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:15.800284 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:15.800286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:15.800286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:15.800293 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:15.801907 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:15.802374 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:15.802375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:15.802376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:15.802443 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:15.802697 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:15.802698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:15.802698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:15.802846 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:15.802922 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:15.803223 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 16:42:15.803330 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:42:15.804421 28778 heartbeater.cc:347] Connected to a master server at 127.27.186.126:32999
I20260811 16:42:15.804560 28778 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:15.804833 28778 heartbeater.cc:511] Master 127.27.186.126:32999 requested a full tablet report, sending...
I20260811 16:42:15.805760 28470 ts_manager.cc:194] Registered new tserver with Master: d0cb4a1e28a84d689e39d556436879dc (127.27.186.65:46225)
I20260811 16:42:15.806759 28470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:40241
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:15.832207 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32999
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:15.954536 28787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:15.954777 28787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:15.954818 28787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:15.956024 28787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:15.956087 28787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:15.956135 28787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:15.957684 28787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:15.957965 28787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:15.958189 28787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:15.964178 28803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:15.964308 28794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:15.964471 28796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:15.964833 28787 server_base.cc:1034] running on GCE node
I20260811 16:42:15.965062 28787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:15.965299 28787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:15.966485 28787 hybrid_clock.cc:648] HybridClock initialized: now 1786466535966452 us; error 43 us; skew 500 ppm
Aug 11 16:42:15 dist-test-slave-gsp7 krb5kdc[28401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466535, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:15.969267 28787 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:15.969802 28787 webserver.cc:460] Webserver started at http://127.27.186.66:43589/ using document root <none> and password file <none>
I20260811 16:42:15.970039 28787 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:15.970084 28787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:15.970229 28787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:15.971370 28787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "c401b2411e03449da7bec74f1f47b808"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "f0fbc4a7731e85ed8533e6e21e25f914"
server_key_iv: "e27ebe1f2772eb10cf222df88ba841a3"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.971784 28787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "c401b2411e03449da7bec74f1f47b808"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "f0fbc4a7731e85ed8533e6e21e25f914"
server_key_iv: "e27ebe1f2772eb10cf222df88ba841a3"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.973186 28787 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:15.974016 28815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:15.974244 28787 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:15.974360 28787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "c401b2411e03449da7bec74f1f47b808"
format_stamp: "Formatted at 2026-08-11 16:42:15 on dist-test-slave-gsp7"
server_key: "f0fbc4a7731e85ed8533e6e21e25f914"
server_key_iv: "e27ebe1f2772eb10cf222df88ba841a3"
server_key_version: "encryptionkey@0"
I20260811 16:42:15.974436 28787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:15.990334 28787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:15.992931 28787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:15.993108 28787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:15.993381 28787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:15.993777 28787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:15.993814 28787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:15.993837 28787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:15.993888 28787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:16.002652 28787 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:45603
I20260811 16:42:16.002712 28990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:45603 every 8 connection(s)
I20260811 16:42:16.003034 28787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[28401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466535, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:16.009215 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28787
I20260811 16:42:16.009323 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:16.009542 28393 external_mini_cluster.cc:1428] Setting key dad1ee8d5934afc7af19ccc8340fd33e
I20260811 16:42:16.012933 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:16.003896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:55917 (local address 127.27.186.126:32999)
0811 16:42:16.003968 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:16.003970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:16.004240 (+ 270us) server_negotiation.cc:407] Connection header received
0811 16:42:16.004735 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:16.004736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:16.004746 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:16.004806 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:16.005802 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.006303 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.007268 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.007455 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.007506 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:16.009927 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:16.009928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:16.009928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:16.009936 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:16.011487 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:16.011923 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:16.011925 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:16.011925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:16.011988 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:16.012257 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:16.012258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:16.012259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:16.012382 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:16.012454 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:16.012743 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 16:42:16.012834 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:42:16.013146 28996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:16.003860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:32999 (local address 127.27.186.66:55917)
0811 16:42:16.004100 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:16.004146 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:16.004653 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:16.004861 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:16.004865 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:16.005517 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:16.005721 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:16.005727 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.006387 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.006387 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:16.007191 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:16.007193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.007529 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.007530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:16.007636 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:16.008169 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:16.008177 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:16.009802 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:16.011576 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:16.011584 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:16.011587 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:16.011818 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:16.012058 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:16.012059 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:16.012060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:16.012173 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:16.012458 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:16.012466 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:16.012606 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 16:42:16.012720 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 16:42:16.012898 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":110,"threads_started":1}
I20260811 16:42:16.013681 28991 heartbeater.cc:347] Connected to a master server at 127.27.186.126:32999
I20260811 16:42:16.013794 28991 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:16.013991 28991 heartbeater.cc:511] Master 127.27.186.126:32999 requested a full tablet report, sending...
I20260811 16:42:16.014422 28470 ts_manager.cc:194] Registered new tserver with Master: c401b2411e03449da7bec74f1f47b808 (127.27.186.66:45603)
I20260811 16:42:16.014806 28470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:55917
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:16.040385 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32999
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:16.131450 28999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:16.131660 28999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:16.131685 28999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:16.132777 28999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:16.132814 28999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:16.132840 28999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:16.134430 28999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:16.134622 28999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:16.134800 28999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:16.140242 29016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:16.140484 28999 server_base.cc:1034] running on GCE node
W20260811 16:42:16.140400 29004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:16.140370 29006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:16.140802 28999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:16.141124 28999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:16.142297 28999 hybrid_clock.cc:648] HybridClock initialized: now 1786466536142280 us; error 45 us; skew 500 ppm
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[28401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466536, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:16.145371 28999 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:16.145922 28999 webserver.cc:460] Webserver started at http://127.27.186.67:33767/ using document root <none> and password file <none>
I20260811 16:42:16.146179 28999 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:16.146253 28999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:16.146433 28999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:16.147727 28999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "6dd0d008cfb7463bbfe57ea1d8934e28"
format_stamp: "Formatted at 2026-08-11 16:42:16 on dist-test-slave-gsp7"
server_key: "d0a1cd04de266870d639abe074293dab"
server_key_iv: "a816983fb880b422a792664a36e0218d"
server_key_version: "encryptionkey@0"
I20260811 16:42:16.148167 28999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "6dd0d008cfb7463bbfe57ea1d8934e28"
format_stamp: "Formatted at 2026-08-11 16:42:16 on dist-test-slave-gsp7"
server_key: "d0a1cd04de266870d639abe074293dab"
server_key_iv: "a816983fb880b422a792664a36e0218d"
server_key_version: "encryptionkey@0"
I20260811 16:42:16.149878 28999 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:16.150719 29030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:16.150913 28999 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:16.151027 28999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "6dd0d008cfb7463bbfe57ea1d8934e28"
format_stamp: "Formatted at 2026-08-11 16:42:16 on dist-test-slave-gsp7"
server_key: "d0a1cd04de266870d639abe074293dab"
server_key_iv: "a816983fb880b422a792664a36e0218d"
server_key_version: "encryptionkey@0"
I20260811 16:42:16.151108 28999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:16.161363 28999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:16.163612 28999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:16.163837 28999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:16.164155 28999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:16.164485 28999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:16.164543 28999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:16.164588 28999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:16.164623 28999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:16.173113 28999 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:41999
I20260811 16:42:16.173170 29214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:41999 every 8 connection(s)
I20260811 16:42:16.173611 28999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:16.176577 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28999
I20260811 16:42:16.176676 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:16.176836 28393 external_mini_cluster.cc:1428] Setting key fa8be72ef40c425afc1381ca5e031781
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[28401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466536, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:16.183909 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:16.174474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:45631 (local address 127.27.186.126:32999)
0811 16:42:16.174562 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:16.174564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:16.174767 (+ 203us) server_negotiation.cc:407] Connection header received
0811 16:42:16.175379 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:16.175381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:16.175396 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:16.175458 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:16.176489 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.177120 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.178564 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.178780 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.178865 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:16.181147 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:16.181148 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:16.181149 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:16.181156 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:16.182677 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:16.183104 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:16.183104 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:16.183105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:16.183155 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:16.183384 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:16.183384 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:16.183384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:16.183493 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:16.183547 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:16.183781 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 16:42:16.183845 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 16:42:16.184211 29218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:16.174427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:32999 (local address 127.27.186.67:45631)
0811 16:42:16.174620 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:16.174664 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:16.175272 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:16.175534 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:16.175537 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:16.176124 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:16.176321 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:16.176325 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.177227 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.177229 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:16.178463 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:16.178466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.178875 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.178876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:16.179009 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:16.179510 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:16.179518 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:16.181049 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:16.182761 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:16.182772 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:16.182774 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:16.183032 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:16.183216 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:16.183217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:16.183217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:16.183326 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:16.183551 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:16.183556 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:16.183680 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 16:42:16.183762 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:42:16.183886 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":106,"threads_started":1}
I20260811 16:42:16.184844 29215 heartbeater.cc:347] Connected to a master server at 127.27.186.126:32999
I20260811 16:42:16.184942 29215 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:16.185199 29215 heartbeater.cc:511] Master 127.27.186.126:32999 requested a full tablet report, sending...
I20260811 16:42:16.185676 28470 ts_manager.cc:194] Registered new tserver with Master: 6dd0d008cfb7463bbfe57ea1d8934e28 (127.27.186.67:41999)
I20260811 16:42:16.186079 28470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:45631
I20260811 16:42:16.189430 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[28401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466536, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[28401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466536, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:16.215504 29223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:16.207156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37046 (local address 127.27.186.65:46225)
0811 16:42:16.207454 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:16.207459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:16.207470 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:16.207499 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:16.207501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:16.207516 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:16.207583 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:16.208184 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.209045 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.209851 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.210221 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.210297 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:16.212667 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:16.212677 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:16.212678 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:16.212692 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:16.214261 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:16.214626 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:16.214630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:16.214632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:16.214693 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:16.214900 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:16.214902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:16.214902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:16.215047 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:16.215236 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:16.215281 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 16:42:16.215365 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":190,"threads_started":1}
W20260811 16:42:16.216012 28637 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37046
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[28401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[28401](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466536, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:16.240399 29223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:16.233573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37054 (local address 127.27.186.65:46225)
0811 16:42:16.233684 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:16.233686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:16.233704 (+ 18us) server_negotiation.cc:407] Connection header received
0811 16:42:16.233731 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:16.233732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:16.233741 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:16.233799 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:16.234389 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.234904 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.235661 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:16.235869 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:16.235929 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:16.238263 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:16.238264 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:16.238265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:16.238271 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:16.239439 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:16.239740 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:16.239741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:16.239742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:16.239789 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:16.239933 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:16.239933 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:16.239933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:16.240059 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:16.240144 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:16.240275 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 16:42:16.240335 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 16:42:16.241034 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28562
I20260811 16:42:16.256187 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28787
I20260811 16:42:16.277890 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28999
I20260811 16:42:16.292325 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28416
2026-08-11T16:42:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2367 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[29238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[29238](info): set up 2 sockets
Aug 11 16:42:16 dist-test-slave-gsp7 krb5kdc[29238](info): commencing operation
krb5kdc: starting...
W20260811 16:42:17.576850 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:17 dist-test-slave-gsp7 krb5kdc[29238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:17.704198 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:38849
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:38429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:38849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:17.786928 29257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:17.787151 29257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:17.787174 29257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:17.788271 29257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:17.788307 29257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:17.788321 29257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:17.788334 29257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:17.788347 29257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:17.789875 29257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:38849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:38849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:17.790094 29257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:17.790273 29257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:17.795316 29266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:17.795306 29265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:17.795409 29269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:17.795626 29257 server_base.cc:1034] running on GCE node
I20260811 16:42:17.795903 29257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:17.796192 29257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:17.797367 29257 hybrid_clock.cc:648] HybridClock initialized: now 1786466537797358 us; error 36 us; skew 500 ppm
Aug 11 16:42:17 dist-test-slave-gsp7 krb5kdc[29238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466537, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:17.799916 29257 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:17.800472 29257 webserver.cc:460] Webserver started at http://127.27.186.126:46253/ using document root <none> and password file <none>
I20260811 16:42:17.800714 29257 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:17.800808 29257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:17.800973 29257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:17.802228 29257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "33e205b3b903457b9d3e0ce70f600cf7"
format_stamp: "Formatted at 2026-08-11 16:42:17 on dist-test-slave-gsp7"
server_key: "953e328932133e36281c634f4b68bb74"
server_key_iv: "8a58c03a5c7c1359ee77f48ec322236a"
server_key_version: "encryptionkey@0"
I20260811 16:42:17.802640 29257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "33e205b3b903457b9d3e0ce70f600cf7"
format_stamp: "Formatted at 2026-08-11 16:42:17 on dist-test-slave-gsp7"
server_key: "953e328932133e36281c634f4b68bb74"
server_key_iv: "8a58c03a5c7c1359ee77f48ec322236a"
server_key_version: "encryptionkey@0"
I20260811 16:42:17.804219 29257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:17.805114 29278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:17.805347 29257 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:17.805511 29257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "33e205b3b903457b9d3e0ce70f600cf7"
format_stamp: "Formatted at 2026-08-11 16:42:17 on dist-test-slave-gsp7"
server_key: "953e328932133e36281c634f4b68bb74"
server_key_iv: "8a58c03a5c7c1359ee77f48ec322236a"
server_key_version: "encryptionkey@0"
I20260811 16:42:17.805614 29257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:17.825857 29257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:17.828148 29257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:17.828359 29257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:17.833226 29257 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:38849
I20260811 16:42:17.833266 29376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:38849 every 8 connection(s)
I20260811 16:42:17.833711 29257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:17.834631 29377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:17.837344 29377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7: Bootstrap starting.
I20260811 16:42:17.838059 29377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:17.838424 29377 log.cc:824] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:17.839977 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29257
I20260811 16:42:17.840058 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:17.840245 28393 external_mini_cluster.cc:1428] Setting key bf1418a31839141c023649656142915e
I20260811 16:42:17.840512 29377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7: No bootstrap required, opened a new log
I20260811 16:42:17.843063 29377 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e205b3b903457b9d3e0ce70f600cf7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 38849 } }
I20260811 16:42:17.843230 29377 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:17.843276 29377 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e205b3b903457b9d3e0ce70f600cf7, State: Initialized, Role: FOLLOWER
I20260811 16:42:17.843449 29377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e205b3b903457b9d3e0ce70f600cf7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 38849 } }
I20260811 16:42:17.843549 29377 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:17.843593 29377 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:17.843641 29377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:17.844235 29377 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e205b3b903457b9d3e0ce70f600cf7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 38849 } }
I20260811 16:42:17.844362 29377 leader_election.cc:302] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33e205b3b903457b9d3e0ce70f600cf7; no voters:
I20260811 16:42:17.844552 29377 leader_election.cc:288] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:17.844606 29384 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:17.844806 29384 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [term 1 LEADER]: Becoming Leader. State: Replica: 33e205b3b903457b9d3e0ce70f600cf7, State: Running, Role: LEADER
I20260811 16:42:17.844831 29377 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:17.844966 29384 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e205b3b903457b9d3e0ce70f600cf7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 38849 } }
I20260811 16:42:17.845420 29386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33e205b3b903457b9d3e0ce70f600cf7. Latest consensus state: current_term: 1 leader_uuid: "33e205b3b903457b9d3e0ce70f600cf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e205b3b903457b9d3e0ce70f600cf7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 38849 } } }
I20260811 16:42:17.845422 29385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33e205b3b903457b9d3e0ce70f600cf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33e205b3b903457b9d3e0ce70f600cf7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 38849 } } }
I20260811 16:42:17.845561 29386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:17.845597 29385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:17.845793 29392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:17.846390 29392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:17.848212 29392 catalog_manager.cc:1347] Generated new cluster ID: 2ea880f518f74b16ae47f5d2d0d62f08
I20260811 16:42:17.848275 29392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:42:17 dist-test-slave-gsp7 krb5kdc[29238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:17.852803 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:17.840860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36810 (local address 127.27.186.126:38849)
0811 16:42:17.841075 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:17.841083 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:17.841112 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:42:17.841983 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:17.841991 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:17.842044 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:17.842168 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:17.842989 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:17.844417 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:17.845615 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:17.846307 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:17.846402 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:17.849130 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:17.849134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:17.849134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:17.849145 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:17.851212 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:17.851596 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:17.851599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:17.851600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:17.851711 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:17.851908 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:17.851909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:17.851909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:17.852211 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:17.852354 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:17.852455 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 16:42:17.852597 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":109,"threads_started":1}
I20260811 16:42:17.864812 29392 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:17.865440 29392 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:17.874316 29392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33e205b3b903457b9d3e0ce70f600cf7: Generated new TSK 0
I20260811 16:42:17.874555 29392 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:17.912927 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:38849
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:38429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:18.027099 29413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:18.027321 29413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:18.027347 29413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:18.028518 29413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:18.028561 29413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:18.028615 29413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:18.030345 29413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:38849
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:18.030627 29413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:18.030879 29413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:18.036073 29425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:18.036068 29429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:18.036144 29413 server_base.cc:1034] running on GCE node
W20260811 16:42:18.036068 29427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:18.036473 29413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:18.036736 29413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:18.037919 29413 hybrid_clock.cc:648] HybridClock initialized: now 1786466538037906 us; error 27 us; skew 500 ppm
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:18.040702 29413 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:18.041189 29413 webserver.cc:460] Webserver started at http://127.27.186.65:45159/ using document root <none> and password file <none>
I20260811 16:42:18.041441 29413 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:18.041539 29413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:18.041689 29413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:18.042784 29413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "62b86daf945db19d7ab39dadc203333b"
server_key_iv: "94022927773a61fa5b0f4493ab0860bb"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.043188 29413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "62b86daf945db19d7ab39dadc203333b"
server_key_iv: "94022927773a61fa5b0f4493ab0860bb"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.044608 29413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:18.045460 29440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.045730 29413 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:18.045820 29413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "62b86daf945db19d7ab39dadc203333b"
server_key_iv: "94022927773a61fa5b0f4493ab0860bb"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.045876 29413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:18.063153 29413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:18.065078 29413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:18.065200 29413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:18.065395 29413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:18.065779 29413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:18.065816 29413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.065838 29413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:18.065893 29413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.072237 29413 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:38857
I20260811 16:42:18.072326 29613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:38857 every 8 connection(s)
I20260811 16:42:18.072674 29413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:18.079814 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29413
I20260811 16:42:18.079924 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:18.080133 28393 external_mini_cluster.cc:1428] Setting key 48924785be779bb75099b787e8291911
I20260811 16:42:18.083235 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.073530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:53683 (local address 127.27.186.126:38849)
0811 16:42:18.073619 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.073622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.073844 (+ 222us) server_negotiation.cc:407] Connection header received
0811 16:42:18.074997 (+ 1153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.074999 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.075009 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.075065 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:18.075687 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.076196 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.077173 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.077362 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.077413 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.079840 (+ 2427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:18.079842 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:18.079843 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:18.079850 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:18.081786 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.082196 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.082197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.082197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.082260 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.082491 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.082492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.082492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.082640 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:18.082712 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.083095 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.083168 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:42:18.083510 29616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.073440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:38849 (local address 127.27.186.65:53683)
0811 16:42:18.073701 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:18.073751 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:18.074884 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:18.075147 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:18.075150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:18.075407 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:18.075611 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.075615 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.076282 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.076283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.077098 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.077099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.077441 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.077442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.077609 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.078190 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:18.078198 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:18.079737 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:18.081879 (+ 2142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:18.081886 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:18.081887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:18.082120 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:18.082329 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:18.082330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:18.082330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:18.082425 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:18.082739 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:18.082746 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:18.082931 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 16:42:18.083068 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 16:42:18.083251 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":144,"threads_started":1}
I20260811 16:42:18.084158 29614 heartbeater.cc:347] Connected to a master server at 127.27.186.126:38849
I20260811 16:42:18.084271 29614 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:18.084457 29614 heartbeater.cc:511] Master 127.27.186.126:38849 requested a full tablet report, sending...
I20260811 16:42:18.085069 29311 ts_manager.cc:194] Registered new tserver with Master: 3ebc831ea3ee4ba3b48eafff80f7a38b (127.27.186.65:38857)
I20260811 16:42:18.086084 29311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:53683
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:18.110023 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:38849
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:38429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:18.195175 29619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:18.195379 29619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:18.195405 29619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:18.196497 29619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:18.196535 29619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:18.196563 29619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:18.198081 29619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:38849
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:18.198271 29619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:18.198460 29619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:18.204013 29633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:18.204020 29636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:18.204013 29634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:18.204061 29619 server_base.cc:1034] running on GCE node
I20260811 16:42:18.204653 29619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:18.205003 29619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:18.206187 29619 hybrid_clock.cc:648] HybridClock initialized: now 1786466538206170 us; error 32 us; skew 500 ppm
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:18.208879 29619 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:18.209376 29619 webserver.cc:460] Webserver started at http://127.27.186.66:37773/ using document root <none> and password file <none>
I20260811 16:42:18.209689 29619 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:18.209765 29619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:18.209903 29619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:18.211016 29619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "835d238bb4a14019be1a8ccd5a11d910"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "27c8d176697780715e8cf621ca380068"
server_key_iv: "5a86d7ecbcdbb375702dae7bd2f96ae0"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.211413 29619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "835d238bb4a14019be1a8ccd5a11d910"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "27c8d176697780715e8cf621ca380068"
server_key_iv: "5a86d7ecbcdbb375702dae7bd2f96ae0"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.212832 29619 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:18.213703 29649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.213932 29619 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:18.214051 29619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "835d238bb4a14019be1a8ccd5a11d910"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "27c8d176697780715e8cf621ca380068"
server_key_iv: "5a86d7ecbcdbb375702dae7bd2f96ae0"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.214133 29619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:18.221886 29619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:18.224284 29619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:18.224457 29619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:18.224701 29619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:18.225026 29619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:18.225088 29619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.225131 29619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:18.225155 29619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.231510 29619 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:38151
I20260811 16:42:18.231559 29844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:38151 every 8 connection(s)
I20260811 16:42:18.231868 29619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:18.235509 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29619
I20260811 16:42:18.235613 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:18.235806 28393 external_mini_cluster.cc:1428] Setting key 0de2fb5c435daa5b74a6dc0be0122a42
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:18.242975 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.232674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:41723 (local address 127.27.186.126:38849)
0811 16:42:18.232753 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.232755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.232959 (+ 204us) server_negotiation.cc:407] Connection header received
0811 16:42:18.233974 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.233975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.233985 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.234040 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:18.234684 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.235179 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.236808 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.236995 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.237049 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.239880 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:18.239882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:18.239882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:18.239889 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:18.241521 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.241971 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.241972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.241973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.242035 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.242302 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.242303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.242303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.242429 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:18.242509 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.242792 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.242874 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:42:18.243178 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.232629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:38849 (local address 127.27.186.66:41723)
0811 16:42:18.232813 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:18.232859 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:18.233873 (+ 1014us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:18.234106 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:18.234110 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:18.234380 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:18.234604 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.234609 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.235271 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.235272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.236720 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.236725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.237092 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.237093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.237255 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.237829 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:18.237840 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:18.239777 (+ 1937us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:18.241626 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:18.241633 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:18.241635 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:18.241863 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:18.242114 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:18.242115 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:18.242115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:18.242229 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:18.242513 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:18.242520 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:18.242655 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 16:42:18.242770 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 16:42:18.242941 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":98,"threads_started":1}
I20260811 16:42:18.243702 29846 heartbeater.cc:347] Connected to a master server at 127.27.186.126:38849
I20260811 16:42:18.243817 29846 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:18.244045 29846 heartbeater.cc:511] Master 127.27.186.126:38849 requested a full tablet report, sending...
I20260811 16:42:18.244491 29311 ts_manager.cc:194] Registered new tserver with Master: 835d238bb4a14019be1a8ccd5a11d910 (127.27.186.66:38151)
I20260811 16:42:18.244868 29311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:41723
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:18.266940 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:38849
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:38429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:18.354574 29855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:18.354775 29855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:18.354799 29855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:18.355937 29855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:18.355978 29855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:18.356004 29855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:18.357525 29855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:38849
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:18.357781 29855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:18.358038 29855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:18.363309 29865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:18.363293 29863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:18.363294 29862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:18.363674 29855 server_base.cc:1034] running on GCE node
I20260811 16:42:18.363894 29855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:18.364138 29855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:18.365336 29855 hybrid_clock.cc:648] HybridClock initialized: now 1786466538365320 us; error 38 us; skew 500 ppm
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:18.367867 29855 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:18.368369 29855 webserver.cc:460] Webserver started at http://127.27.186.67:44617/ using document root <none> and password file <none>
I20260811 16:42:18.368607 29855 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:18.368680 29855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:18.368814 29855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:18.370033 29855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "da29508cb9f4deef549d16dac22a071d"
server_key_iv: "e3aea641f1718a3d471381e5dce8a440"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.370497 29855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "da29508cb9f4deef549d16dac22a071d"
server_key_iv: "e3aea641f1718a3d471381e5dce8a440"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.371920 29855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:42:18.372757 29874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.372980 29855 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:18.373095 29855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596"
format_stamp: "Formatted at 2026-08-11 16:42:18 on dist-test-slave-gsp7"
server_key: "da29508cb9f4deef549d16dac22a071d"
server_key_iv: "e3aea641f1718a3d471381e5dce8a440"
server_key_version: "encryptionkey@0"
I20260811 16:42:18.373174 29855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:18.386092 29855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:18.388072 29855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:18.388326 29855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:18.388685 29855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:18.389076 29855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:18.389138 29855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.389182 29855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:18.389209 29855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:18.397455 29855 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:38547
I20260811 16:42:18.397544 30058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:38547 every 8 connection(s)
I20260811 16:42:18.397936 29855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:18.402778 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29855
I20260811 16:42:18.402886 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:18.403069 28393 external_mini_cluster.cc:1428] Setting key f0037aa693def4c57eb73cf0e8002d37
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:18.408090 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.398720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:44525 (local address 127.27.186.126:38849)
0811 16:42:18.398764 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.398766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.398971 (+ 205us) server_negotiation.cc:407] Connection header received
0811 16:42:18.400054 (+ 1083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.400056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.400070 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.400149 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:18.400785 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.401393 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.402555 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.402869 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.402949 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.405603 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:18.405605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:18.405605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:18.405612 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:18.406822 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.407207 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.407208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.407208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.407257 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.407471 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.407471 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.407472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.407569 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:18.407620 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.407903 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.407969 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:42:18.408215 30063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.398674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:38849 (local address 127.27.186.67:44525)
0811 16:42:18.398845 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:18.398887 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:18.399934 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:18.400224 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:18.400228 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:18.400502 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:18.400700 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.400705 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.401564 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.401565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.402475 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.402477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.403023 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.403024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.403172 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.403862 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:18.403873 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:18.405449 (+ 1576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:18.406905 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:18.406912 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:18.406913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:18.407142 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:18.407317 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:18.407317 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:18.407318 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:18.407415 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:18.407627 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:18.407631 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:18.407743 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 16:42:18.407824 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:42:18.407942 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260811 16:42:18.408727 30059 heartbeater.cc:347] Connected to a master server at 127.27.186.126:38849
I20260811 16:42:18.408809 30059 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:18.409015 30059 heartbeater.cc:511] Master 127.27.186.126:38849 requested a full tablet report, sending...
I20260811 16:42:18.409456 29311 ts_manager.cc:194] Registered new tserver with Master: a0dcff45cd8342c4a9ab50a1a0ce7596 (127.27.186.67:38547)
I20260811 16:42:18.409878 29311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:44525
I20260811 16:42:18.414970 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:42:18.422914 29382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.416710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36824 (local address 127.27.186.126:38849)
0811 16:42:18.416797 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.416800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.416921 (+ 121us) server_negotiation.cc:407] Connection header received
0811 16:42:18.417003 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.417004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.417014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.417059 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:18.417679 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.418284 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.419024 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.419228 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.419309 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.420505 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:18.420506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:18.420506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:18.420513 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:18.421704 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.422076 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.422077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.422078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.422137 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.422341 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.422342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.422342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.422497 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:18.422613 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.422718 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.422805 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:42:18.425361 29311 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36824:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:18.427196 29311 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:18.435241 30091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.430522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:38151 (local address 127.0.0.1:41674)
0811 16:42:18.430722 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:18.430731 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:18.430767 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:18.431429 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:18.431430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:18.431432 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:18.431472 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.431474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.432368 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.432369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.433749 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.433751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.434899 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.434901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.434995 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.435009 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:42:18.435095 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:42:18.435157 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":27,"thread_start_us":79,"threads_started":1}
I20260811 16:42:18.435259 30094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.430768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41674 (local address 127.27.186.66:38151)
0811 16:42:18.431095 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.431098 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.431107 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:18.431173 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.431176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.431192 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.431437 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:18.431559 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.432245 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.433844 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.434796 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.434880 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.434939 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.435128 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.435174 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":86,"threads_started":1}
I20260811 16:42:18.435501 30086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.430216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:38857 (local address 127.0.0.1:47288)
0811 16:42:18.430410 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:18.430497 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:18.430567 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:18.430874 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:18.430877 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:18.430880 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:18.430967 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.430970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.432448 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.432449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.434381 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.434384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.435225 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.435226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.435295 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.435299 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:18.435353 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:42:18.435410 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":741,"thread_start_us":69,"threads_started":1}
I20260811 16:42:18.435847 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.430336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47288 (local address 127.27.186.65:38857)
0811 16:42:18.430675 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.430681 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.430692 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:18.430736 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.430739 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.430755 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.431085 (+ 330us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:18.431196 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.432304 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.434476 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.435076 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.435141 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.435191 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.435682 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.435732 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":120,"threads_started":1}
I20260811 16:42:18.436241 29737 tablet_service.cc:1467] Processing CreateTablet for tablet 94fe9c0967e64de3988b37e153c811df (DEFAULT_TABLE table=test-table [id=511d4fe4f5b145408f20d228855a4517]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:18.436591 29737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94fe9c0967e64de3988b37e153c811df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:18.436595 29517 tablet_service.cc:1467] Processing CreateTablet for tablet 94fe9c0967e64de3988b37e153c811df (DEFAULT_TABLE table=test-table [id=511d4fe4f5b145408f20d228855a4517]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:18.436941 29517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94fe9c0967e64de3988b37e153c811df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:18.437995 30085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.430221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38547 (local address 127.0.0.1:37172)
0811 16:42:18.430575 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:18.430587 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:18.430643 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:18.430881 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:18.430882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:18.430884 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:18.430972 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.430974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.432577 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.432578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.433744 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.433747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.437719 (+ 3972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.437721 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.437787 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.437792 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:18.437877 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:42:18.437917 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":12,"thread_start_us":99,"threads_started":1}
I20260811 16:42:18.438192 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.430354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37172 (local address 127.27.186.67:38547)
0811 16:42:18.430722 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.430727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.430735 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:18.430771 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.430773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.430790 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.430862 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:18.431067 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.432450 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.434634 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.437626 (+ 2992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.437703 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.437756 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.437911 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.437957 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":162,"threads_started":1}
I20260811 16:42:18.439895 30097 tablet_bootstrap.cc:492] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910: Bootstrap starting.
I20260811 16:42:18.440141 30098 tablet_bootstrap.cc:492] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b: Bootstrap starting.
I20260811 16:42:18.440829 30098 tablet_bootstrap.cc:654] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:18.441085 29959 tablet_service.cc:1467] Processing CreateTablet for tablet 94fe9c0967e64de3988b37e153c811df (DEFAULT_TABLE table=test-table [id=511d4fe4f5b145408f20d228855a4517]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:18.441330 30097 tablet_bootstrap.cc:654] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:18.441470 29959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94fe9c0967e64de3988b37e153c811df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:18.441782 30098 log.cc:824] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:18.442662 30098 tablet_bootstrap.cc:492] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b: No bootstrap required, opened a new log
I20260811 16:42:18.442665 30097 log.cc:824] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:18.442759 30098 ts_tablet_manager.cc:1397] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 16:42:18.443660 30097 tablet_bootstrap.cc:492] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910: No bootstrap required, opened a new log
I20260811 16:42:18.443768 30097 ts_tablet_manager.cc:1397] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 16:42:18.446168 30098 raft_consensus.cc:348] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.446377 30098 raft_consensus.cc:374] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:18.446430 30098 raft_consensus.cc:729] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ebc831ea3ee4ba3b48eafff80f7a38b, State: Initialized, Role: FOLLOWER
I20260811 16:42:18.446549 30098 consensus_queue.cc:260] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.447060 29614 heartbeater.cc:503] Master 127.27.186.126:38849 was elected leader, sending a full tablet report...
I20260811 16:42:18.447088 30098 ts_tablet_manager.cc:1428] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 16:42:18.448338 30105 tablet_bootstrap.cc:492] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596: Bootstrap starting.
I20260811 16:42:18.448385 30097 raft_consensus.cc:348] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.448655 30097 raft_consensus.cc:374] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:18.448715 30097 raft_consensus.cc:729] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 835d238bb4a14019be1a8ccd5a11d910, State: Initialized, Role: FOLLOWER
I20260811 16:42:18.448844 30097 consensus_queue.cc:260] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.449342 30097 ts_tablet_manager.cc:1428] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260811 16:42:18.449347 29846 heartbeater.cc:503] Master 127.27.186.126:38849 was elected leader, sending a full tablet report...
I20260811 16:42:18.450078 30105 tablet_bootstrap.cc:654] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:18.451321 30105 log.cc:824] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:18.452296 30105 tablet_bootstrap.cc:492] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596: No bootstrap required, opened a new log
I20260811 16:42:18.452397 30105 ts_tablet_manager.cc:1397] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260811 16:42:18.455410 30105 raft_consensus.cc:348] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.455617 30105 raft_consensus.cc:374] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:18.455670 30105 raft_consensus.cc:729] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0dcff45cd8342c4a9ab50a1a0ce7596, State: Initialized, Role: FOLLOWER
I20260811 16:42:18.455796 30105 consensus_queue.cc:260] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.456230 30105 ts_tablet_manager.cc:1428] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 16:42:18.456251 30059 heartbeater.cc:503] Master 127.27.186.126:38849 was elected leader, sending a full tablet report...
W20260811 16:42:18.482668 29849 tablet.cc:2369] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:42:18.573537 29615 tablet.cc:2369] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:42:18.648655 30062 tablet.cc:2369] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:18.678660 30108 raft_consensus.cc:482] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:18.678858 30108 raft_consensus.cc:504] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.679298 30108 leader_election.cc:288] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0dcff45cd8342c4a9ab50a1a0ce7596 (127.27.186.67:38547), 3ebc831ea3ee4ba3b48eafff80f7a38b (127.27.186.65:38857)
I20260811 16:42:18.683442 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.679685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:58111 (local address 127.27.186.65:38857)
0811 16:42:18.679741 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.679743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.679870 (+ 127us) server_negotiation.cc:407] Connection header received
0811 16:42:18.679922 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.679924 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.679934 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.679992 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:18.680163 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.680896 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.682450 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.683006 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.683087 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.683096 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.683329 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.683384 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:42:18.683440 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.679653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:50251 (local address 127.27.186.67:38547)
0811 16:42:18.679718 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.679720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.679732 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:42:18.679767 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.679768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.679778 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.679891 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:18.680128 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.680900 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.682450 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.683014 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.683087 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.683096 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.683329 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.683368 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:42:18.683470 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.679519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38547 (local address 127.27.186.66:50251)
0811 16:42:18.679596 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:18.679612 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:18.679675 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:18.679902 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:18.679903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:18.679905 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:18.680019 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.680021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.681007 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.681008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.682349 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.682353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.683104 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.683106 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.683221 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.683225 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:18.683300 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:42:18.683347 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":21}
I20260811 16:42:18.683525 30115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.679519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:38857 (local address 127.27.186.66:58111)
0811 16:42:18.679781 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:18.679789 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:18.679865 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:18.680011 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:18.680012 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:18.680014 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:18.680076 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.680078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.681007 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.681008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.682349 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:18.682353 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.683105 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.683106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:18.683244 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.683248 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:18.683302 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:42:18.683347 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":83,"thread_start_us":136,"threads_started":1}
I20260811 16:42:18.683852 29989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94fe9c0967e64de3988b37e153c811df" candidate_uuid: "835d238bb4a14019be1a8ccd5a11d910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" is_pre_election: true
I20260811 16:42:18.684062 29989 raft_consensus.cc:2454] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 835d238bb4a14019be1a8ccd5a11d910 in term 0.
I20260811 16:42:18.684002 29548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94fe9c0967e64de3988b37e153c811df" candidate_uuid: "835d238bb4a14019be1a8ccd5a11d910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" is_pre_election: true
I20260811 16:42:18.684182 29548 raft_consensus.cc:2454] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 835d238bb4a14019be1a8ccd5a11d910 in term 0.
I20260811 16:42:18.684438 29653 leader_election.cc:302] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ebc831ea3ee4ba3b48eafff80f7a38b, 835d238bb4a14019be1a8ccd5a11d910; no voters:
I20260811 16:42:18.684597 30108 raft_consensus.cc:2781] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:18.684657 30108 raft_consensus.cc:482] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:18.684684 30108 raft_consensus.cc:3037] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:18.685391 30108 raft_consensus.cc:504] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.685573 30108 leader_election.cc:288] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [CANDIDATE]: Term 1 election: Requested vote from peers a0dcff45cd8342c4a9ab50a1a0ce7596 (127.27.186.67:38547), 3ebc831ea3ee4ba3b48eafff80f7a38b (127.27.186.65:38857)
I20260811 16:42:18.685731 29989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94fe9c0967e64de3988b37e153c811df" candidate_uuid: "835d238bb4a14019be1a8ccd5a11d910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596"
I20260811 16:42:18.685811 29989 raft_consensus.cc:3037] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:18.685909 29548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94fe9c0967e64de3988b37e153c811df" candidate_uuid: "835d238bb4a14019be1a8ccd5a11d910" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b"
I20260811 16:42:18.686017 29548 raft_consensus.cc:3037] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:18.686627 29989 raft_consensus.cc:2454] T 94fe9c0967e64de3988b37e153c811df P a0dcff45cd8342c4a9ab50a1a0ce7596 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 835d238bb4a14019be1a8ccd5a11d910 in term 1.
I20260811 16:42:18.686810 29651 leader_election.cc:302] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 835d238bb4a14019be1a8ccd5a11d910, a0dcff45cd8342c4a9ab50a1a0ce7596; no voters:
I20260811 16:42:18.686913 30108 raft_consensus.cc:2781] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:18.687089 30108 raft_consensus.cc:686] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [term 1 LEADER]: Becoming Leader. State: Replica: 835d238bb4a14019be1a8ccd5a11d910, State: Running, Role: LEADER
I20260811 16:42:18.687193 30108 consensus_queue.cc:237] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } }
I20260811 16:42:18.687325 29548 raft_consensus.cc:2454] T 94fe9c0967e64de3988b37e153c811df P 3ebc831ea3ee4ba3b48eafff80f7a38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 835d238bb4a14019be1a8ccd5a11d910 in term 1.
I20260811 16:42:18.688172 29311 catalog_manager.cc:5495] T 94fe9c0967e64de3988b37e153c811df P 835d238bb4a14019be1a8ccd5a11d910 reported cstate change: term changed from 0 to 1, leader changed from <none> to 835d238bb4a14019be1a8ccd5a11d910 (127.27.186.66). New cstate: current_term: 1 leader_uuid: "835d238bb4a14019be1a8ccd5a11d910" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0dcff45cd8342c4a9ab50a1a0ce7596" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ebc831ea3ee4ba3b48eafff80f7a38b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 38857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "835d238bb4a14019be1a8ccd5a11d910" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 38151 } health_report { overall_health: HEALTHY } } }
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:18.729377 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.720184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47294 (local address 127.27.186.65:38857)
0811 16:42:18.720242 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.720244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.720543 (+ 299us) server_negotiation.cc:407] Connection header received
0811 16:42:18.720618 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.720620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.720631 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.720686 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:18.721301 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.721863 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.722862 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.723148 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.723228 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.726043 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:18.726058 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:18.726058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:18.726067 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:18.728243 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.728604 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.728607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.728607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.728713 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.728897 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.728898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.728898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.729031 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:18.729133 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.729207 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.729271 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:18.756168 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.748597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47296 (local address 127.27.186.65:38857)
0811 16:42:18.748681 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.748683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.748796 (+ 113us) server_negotiation.cc:407] Connection header received
0811 16:42:18.748897 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.748899 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.748910 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.748991 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:18.749770 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.750277 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.751047 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.751241 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.751330 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.753712 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:18.753714 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:18.753715 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:18.753722 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:18.754881 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.755260 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.755262 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.755262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.755322 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.755545 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.755546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.755546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.755650 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:18.755756 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.755979 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.756061 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[29238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:18.782079 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:18.774405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47310 (local address 127.27.186.65:38857)
0811 16:42:18.774476 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:18.774478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:18.774490 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:42:18.774552 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:18.774553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:18.774564 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:18.774621 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:18.775194 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.775692 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.776475 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:18.776675 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:18.776733 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:18.779404 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:18.779405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:18.779405 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:18.779412 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:18.780993 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.781321 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.781322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.781323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.781382 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:18.781656 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:18.781657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:18.781657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:18.781757 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:18.781834 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:18.781952 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 16:42:18.782010 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 16:42:18.782920 29490 tablet_service.cc:2908] Rejecting scan request for tablet 94fe9c0967e64de3988b37e153c811df: Uninitialized: clean time has not yet been initialized
I20260811 16:42:18.783947 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29413
I20260811 16:42:18.803193 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29619
I20260811 16:42:18.812126 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29855
I20260811 16:42:18.823835 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29257
2026-08-11T16:42:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2533 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[30138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[30138](info): set up 2 sockets
Aug 11 16:42:18 dist-test-slave-gsp7 krb5kdc[30138](info): commencing operation
krb5kdc: starting...
W20260811 16:42:20.111467 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:20.264163 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:46779
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:46779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:20.349220 30154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:20.349582 30154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:20.349648 30154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:20.350958 30154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:20.351003 30154 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:42:20.351017 30154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:20.351071 30154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:20.351107 30154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:20.351125 30154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:20.352715 30154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:46779
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:46779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:20.353014 30154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:20.353299 30154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:20.358716 30162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:20.358723 30160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:20.358925 30154 server_base.cc:1034] running on GCE node
W20260811 16:42:20.358855 30159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:20.359243 30154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:20.359575 30154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:20.360766 30154 hybrid_clock.cc:648] HybridClock initialized: now 1786466540360744 us; error 43 us; skew 500 ppm
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:20.363466 30154 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:20.363963 30154 webserver.cc:460] Webserver started at http://127.27.186.126:43415/ using document root <none> and password file <none>
I20260811 16:42:20.364214 30154 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:20.364261 30154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:20.364436 30154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:20.365612 30154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "0478970bff98401398fe56bd9a73212d"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "88209bc108e07377b042bcb3ed668c31"
server_key_iv: "f15415fc39fb85fcba45cf57e107fb8e"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.366000 30154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "0478970bff98401398fe56bd9a73212d"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "88209bc108e07377b042bcb3ed668c31"
server_key_iv: "f15415fc39fb85fcba45cf57e107fb8e"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.367405 30154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:42:20.368213 30173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:20.368536 30154 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:20.368686 30154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "0478970bff98401398fe56bd9a73212d"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "88209bc108e07377b042bcb3ed668c31"
server_key_iv: "f15415fc39fb85fcba45cf57e107fb8e"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.368798 30154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:20.391397 30154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:20.393682 30154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:20.393864 30154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:20.399509 30154 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:46779
I20260811 16:42:20.399600 30279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:46779 every 8 connection(s)
I20260811 16:42:20.399995 30154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:20.400409 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30154
I20260811 16:42:20.400517 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:20.400698 28393 external_mini_cluster.cc:1428] Setting key a20ab1eb22ca595d9a689699c74ca61b
I20260811 16:42:20.400812 30281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:20.404407 30281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d: Bootstrap starting.
I20260811 16:42:20.405098 30281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:20.405431 30281 log.cc:824] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:20.406327 30281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d: No bootstrap required, opened a new log
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:20.408532 30281 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0478970bff98401398fe56bd9a73212d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46779 } }
I20260811 16:42:20.408699 30281 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:20.408726 30281 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0478970bff98401398fe56bd9a73212d, State: Initialized, Role: FOLLOWER
I20260811 16:42:20.408881 30281 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0478970bff98401398fe56bd9a73212d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46779 } }
I20260811 16:42:20.408977 30281 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:20.409015 30281 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:20.409076 30281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:20.409858 30281 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0478970bff98401398fe56bd9a73212d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46779 } }
I20260811 16:42:20.409971 30281 leader_election.cc:302] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0478970bff98401398fe56bd9a73212d; no voters:
I20260811 16:42:20.410171 30281 leader_election.cc:288] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:20.410231 30292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:20.410410 30292 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [term 1 LEADER]: Becoming Leader. State: Replica: 0478970bff98401398fe56bd9a73212d, State: Running, Role: LEADER
I20260811 16:42:20.410447 30281 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:20.410502 30292 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0478970bff98401398fe56bd9a73212d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46779 } }
I20260811 16:42:20.410827 30292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0478970bff98401398fe56bd9a73212d. Latest consensus state: current_term: 1 leader_uuid: "0478970bff98401398fe56bd9a73212d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0478970bff98401398fe56bd9a73212d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46779 } } }
I20260811 16:42:20.410915 30292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:20.410872 30294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0478970bff98401398fe56bd9a73212d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0478970bff98401398fe56bd9a73212d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46779 } } }
I20260811 16:42:20.411079 30294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:20.411628 30300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:20.412163 30300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:20.412395 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.401350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56842 (local address 127.27.186.126:46779)
0811 16:42:20.401589 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:20.401599 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:20.401632 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:42:20.402099 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:20.402108 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:20.402172 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:20.402337 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:20.402936 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.404304 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.405098 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.405782 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.405868 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.408292 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:20.408297 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:20.408298 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:20.408310 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:20.410497 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.410971 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.410974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.410975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.411102 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.411343 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.411344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.411344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.411690 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:20.411871 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:20.412039 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 16:42:20.412185 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":116,"threads_started":1}
I20260811 16:42:20.413997 30300 catalog_manager.cc:1347] Generated new cluster ID: 8985be93bdbc4b749158a8805c15953f
I20260811 16:42:20.414052 30300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:20.443718 30300 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:20.444502 30300 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:20.451166 30300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d: Generated new TSK 0
I20260811 16:42:20.451370 30300 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:20.493014 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46779
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:20.578567 30321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:20.578771 30321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:20.578794 30321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:20.579955 30321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:20.580001 30321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:20.580022 30321 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:20.580087 30321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:20.581532 30321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:46779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:20.581781 30321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:20.582018 30321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:20.587304 30332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:20.587352 30333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:20.587512 30336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:20.587574 30321 server_base.cc:1034] running on GCE node
I20260811 16:42:20.587821 30321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:20.588104 30321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:20.589273 30321 hybrid_clock.cc:648] HybridClock initialized: now 1786466540589248 us; error 36 us; skew 500 ppm
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:20.591956 30321 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:20.592442 30321 webserver.cc:460] Webserver started at http://127.27.186.65:45483/ using document root <none> and password file <none>
I20260811 16:42:20.592677 30321 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:20.592749 30321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:20.592885 30321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:20.594081 30321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "8861803a8e4b463da6bf132102d38c95"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "ab2981a79e837502302d191b4e885171"
server_key_iv: "efbd5e92bf33aad4c5cce2b7b95fe320"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.594466 30321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "8861803a8e4b463da6bf132102d38c95"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "ab2981a79e837502302d191b4e885171"
server_key_iv: "efbd5e92bf33aad4c5cce2b7b95fe320"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.596005 30321 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:20.596836 30345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:20.597012 30321 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:20.597124 30321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "8861803a8e4b463da6bf132102d38c95"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "ab2981a79e837502302d191b4e885171"
server_key_iv: "efbd5e92bf33aad4c5cce2b7b95fe320"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.597203 30321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:20.613715 30321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:20.616205 30321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:20.616380 30321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:20.616999 30321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:20.617066 30321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:20.617112 30321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:20.617137 30321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:20.625062 30321 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:35867
I20260811 16:42:20.625177 30532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:35867 every 8 connection(s)
I20260811 16:42:20.625492 30321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:20.627085 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.617586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:44547 (local address 127.27.186.126:46779)
0811 16:42:20.617647 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:20.617650 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:20.617863 (+ 213us) server_negotiation.cc:407] Connection header received
0811 16:42:20.618423 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:20.618425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:20.618439 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:20.618498 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:20.619200 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.619720 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.620793 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.621021 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.621122 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.624063 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:20.624065 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:20.624065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:20.624074 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:20.625726 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.626173 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.626174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.626174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.626239 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.626521 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.626521 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.626522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.626636 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:20.626693 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:20.626939 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 16:42:20.627021 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:42:20.627239 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.617556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46779 (local address 127.27.186.65:44547)
0811 16:42:20.617736 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:20.617773 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:20.618301 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:20.618576 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:20.618580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:20.618888 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:20.619094 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.619100 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.619825 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.619826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.620694 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.620697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.621133 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.621134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.621275 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.621891 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:20.621900 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:20.623951 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:20.625816 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.625824 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.625826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.626087 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.626324 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.626325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.626325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.626431 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.626703 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:20.626708 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:20.626826 (+ 118us) client_negotiation.cc:769] Sending connection context
0811 16:42:20.626911 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:42:20.627038 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
I20260811 16:42:20.627771 30533 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46779
I20260811 16:42:20.627852 30533 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:20.628062 30533 heartbeater.cc:511] Master 127.27.186.126:46779 requested a full tablet report, sending...
I20260811 16:42:20.628633 30205 ts_manager.cc:194] Registered new tserver with Master: 8861803a8e4b463da6bf132102d38c95 (127.27.186.65:35867)
I20260811 16:42:20.628993 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30321
I20260811 16:42:20.629101 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:20.629274 28393 external_mini_cluster.cc:1428] Setting key 8103ab8db4a95f281a07333164a27b5b
I20260811 16:42:20.629601 30205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:44547
I20260811 16:42:20.635516 30541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.628901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46779 (local address 127.27.186.65:37489)
0811 16:42:20.629051 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:20.629063 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:20.629138 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:20.629287 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:20.629287 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:20.629543 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:20.629612 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.629614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.630363 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.630364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.630901 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.630903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.631292 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.631293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.631372 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.631849 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:20.631854 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:20.632151 (+ 297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:20.634350 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.634351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.634351 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.634527 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.634765 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.634765 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.634766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.634819 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.635201 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:20.635203 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:20.635261 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 16:42:20.635349 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:42:20.635435 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260811 16:42:20.635591 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.628955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:37489 (local address 127.27.186.126:46779)
0811 16:42:20.628995 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:20.628997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:20.629113 (+ 116us) server_negotiation.cc:407] Connection header received
0811 16:42:20.629214 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:20.629215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:20.629225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:20.629282 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:20.629725 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.630250 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.631001 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.631198 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.631289 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.632268 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:20.632269 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:20.632270 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:20.632277 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:20.634236 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.634614 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.634615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.634616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.634683 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.634903 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.634904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.634904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.635057 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:20.635140 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:20.635398 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 16:42:20.635490 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:20.661931 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46779
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:20.754329 30546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:20.754571 30546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:20.754599 30546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:20.755733 30546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:20.755788 30546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:20.755811 30546 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:20.755831 30546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:20.757267 30546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:46779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:20.757553 30546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:20.757797 30546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:20.763306 30556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:20.763429 30546 server_base.cc:1034] running on GCE node
W20260811 16:42:20.763350 30554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:20.763347 30552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:20.763824 30546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:20.764053 30546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:20.765200 30546 hybrid_clock.cc:648] HybridClock initialized: now 1786466540765178 us; error 39 us; skew 500 ppm
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:20.767958 30546 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:20.768450 30546 webserver.cc:460] Webserver started at http://127.27.186.66:37599/ using document root <none> and password file <none>
I20260811 16:42:20.768692 30546 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:20.768739 30546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:20.768916 30546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:20.770133 30546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "dea2ad316b4c45369f8696d4cd4e4e0c"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "a8c86799a9819675f5fe82efc38457e9"
server_key_iv: "dd7c6c95d6cd460fbbb9ceef99d0ad49"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.770536 30546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "dea2ad316b4c45369f8696d4cd4e4e0c"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "a8c86799a9819675f5fe82efc38457e9"
server_key_iv: "dd7c6c95d6cd460fbbb9ceef99d0ad49"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.772078 30546 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:20.772851 30565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:20.773044 30546 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:20.773159 30546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "dea2ad316b4c45369f8696d4cd4e4e0c"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "a8c86799a9819675f5fe82efc38457e9"
server_key_iv: "dd7c6c95d6cd460fbbb9ceef99d0ad49"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.773247 30546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:20.779942 30546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:20.782362 30546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:20.782542 30546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:20.783171 30546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:20.783226 30546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:20.783265 30546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:20.783316 30546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:20.791162 30546 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:46625
I20260811 16:42:20.791605 30546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:20.792372 30761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:46625 every 8 connection(s)
I20260811 16:42:20.793816 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.783670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:45603 (local address 127.27.186.126:46779)
0811 16:42:20.783751 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:20.783753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:20.783979 (+ 226us) server_negotiation.cc:407] Connection header received
0811 16:42:20.784529 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:20.784531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:20.784543 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:20.784603 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:20.785312 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.786030 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.787163 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.787385 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.787472 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.790482 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:20.790484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:20.790485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:20.790494 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:20.792279 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.792831 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.792832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.792832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.792899 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.793161 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.793162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.793162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.793290 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:20.793349 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:20.793676 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 16:42:20.793751 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 16:42:20.793951 30581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.783599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46779 (local address 127.27.186.66:45603)
0811 16:42:20.783827 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:20.783883 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:20.784411 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:20.784678 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:20.784681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:20.784998 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:20.785203 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.785209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.786139 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.786140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.787055 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.787057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.787482 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.787483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.787664 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.788243 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:20.788251 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:20.790371 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:20.792364 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.792369 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.792371 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.792729 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.792983 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.792984 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.792984 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.793082 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.793362 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:20.793365 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:20.793533 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 16:42:20.793639 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 16:42:20.793766 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":99,"threads_started":1}
I20260811 16:42:20.794457 30762 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46779
I20260811 16:42:20.794548 30762 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:20.794730 30762 heartbeater.cc:511] Master 127.27.186.126:46779 requested a full tablet report, sending...
I20260811 16:42:20.795149 30205 ts_manager.cc:194] Registered new tserver with Master: dea2ad316b4c45369f8696d4cd4e4e0c (127.27.186.66:46625)
I20260811 16:42:20.795632 30205 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:45603
I20260811 16:42:20.797959 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30546
I20260811 16:42:20.798070 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:20.798273 28393 external_mini_cluster.cc:1428] Setting key 82e24db383abbc5fdfd4a8c5e9ae7dc3
I20260811 16:42:20.801815 30777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.795550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46779 (local address 127.27.186.66:55251)
0811 16:42:20.795721 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:20.795733 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:20.795789 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:20.795917 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:20.795917 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:20.796082 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:20.796155 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.796156 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.796853 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.796853 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.797359 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.797361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.797792 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.797793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.797912 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.798343 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:20.798348 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:20.798717 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:20.800585 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.800586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.800587 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.800824 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.801085 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.801085 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.801086 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.801140 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.801532 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:20.801533 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:20.801594 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 16:42:20.801654 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:42:20.801738 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":78,"threads_started":1}
I20260811 16:42:20.801877 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.795617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:55251 (local address 127.27.186.126:46779)
0811 16:42:20.795660 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:20.795662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:20.795778 (+ 116us) server_negotiation.cc:407] Connection header received
0811 16:42:20.795837 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:20.795838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:20.795848 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:20.795909 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:20.796237 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.796756 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.797437 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.797697 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.797751 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.798802 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:20.798803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:20.798803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:20.798809 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:20.800488 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.800923 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.800924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.800925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.801000 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.801209 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.801210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.801210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.801426 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:20.801529 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:20.801706 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 16:42:20.801792 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:20.830391 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46779
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:20.920315 30784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:20.920536 30784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:20.920562 30784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:20.921873 30784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:20.921921 30784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:20.921942 30784 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:20.921962 30784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:20.923512 30784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:46779
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:20.923779 30784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:20.924052 30784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:20.929368 30795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:20.929464 30793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:20.929574 30791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:20.929963 30784 server_base.cc:1034] running on GCE node
I20260811 16:42:20.930238 30784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:20.930459 30784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:20.931643 30784 hybrid_clock.cc:648] HybridClock initialized: now 1786466540931632 us; error 34 us; skew 500 ppm
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:20.934763 30784 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:20.935266 30784 webserver.cc:460] Webserver started at http://127.27.186.67:43569/ using document root <none> and password file <none>
I20260811 16:42:20.935544 30784 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:20.935629 30784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:20.935803 30784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:20.937093 30784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "e3953aae3b5e4c6aa0821480baf8730c"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "939fe46db7fda0462a524ca55a646aac"
server_key_iv: "7ee09f62d414e4c05fd9f152031f1aca"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.937629 30784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "e3953aae3b5e4c6aa0821480baf8730c"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "939fe46db7fda0462a524ca55a646aac"
server_key_iv: "7ee09f62d414e4c05fd9f152031f1aca"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.939199 30784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:20.940083 30808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:20.940323 30784 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:20.940440 30784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "e3953aae3b5e4c6aa0821480baf8730c"
format_stamp: "Formatted at 2026-08-11 16:42:20 on dist-test-slave-gsp7"
server_key: "939fe46db7fda0462a524ca55a646aac"
server_key_iv: "7ee09f62d414e4c05fd9f152031f1aca"
server_key_version: "encryptionkey@0"
I20260811 16:42:20.940531 30784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:20.964735 30784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:20.967344 30784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:20.967520 30784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:20.968112 30784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:20.968183 30784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:20.968230 30784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:20.968254 30784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:20.979234 30784 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:40491
I20260811 16:42:20.979336 30991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:40491 every 8 connection(s)
I20260811 16:42:20.979694 30784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:20.979990 30823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.968665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46779 (local address 127.27.186.67:46365)
0811 16:42:20.968864 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:20.968907 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:20.969456 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:20.969879 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:20.969882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:20.970134 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:20.970326 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.970330 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.971643 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.971645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.972637 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.972640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.973082 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.973083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.973228 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.973909 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:20.973919 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:20.976070 (+ 2151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:20.978034 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.978043 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.978046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.978408 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.978648 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.978649 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.978650 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.978791 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.979228 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:20.979234 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:20.979396 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 16:42:20.979521 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 16:42:20.979704 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":111,"threads_started":1}
I20260811 16:42:20.980289 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.968693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:46365 (local address 127.27.186.126:46779)
0811 16:42:20.968758 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:20.968761 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:20.969007 (+ 246us) server_negotiation.cc:407] Connection header received
0811 16:42:20.969688 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:20.969690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:20.969713 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:20.969835 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:20.970509 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.971527 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.972740 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.972971 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.973069 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.976160 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:20.976161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:20.976161 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:20.976169 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:20.977925 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.978500 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.978501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.978501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.978566 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.978941 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.978943 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.978943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.979132 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:20.979227 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:20.980095 (+ 868us) server_negotiation.cc:299] Negotiation successful
0811 16:42:20.980189 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:42:20.980659 30997 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46779
I20260811 16:42:20.980754 30997 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:20.980974 30997 heartbeater.cc:511] Master 127.27.186.126:46779 requested a full tablet report, sending...
I20260811 16:42:20.981410 30207 ts_manager.cc:194] Registered new tserver with Master: e3953aae3b5e4c6aa0821480baf8730c (127.27.186.67:40491)
I20260811 16:42:20.981817 30207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:46365
I20260811 16:42:20.986979 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30784
I20260811 16:42:20.987080 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:20.987246 28393 external_mini_cluster.cc:1428] Setting key b9b5ce479dd78a6c0078668f704e4086
I20260811 16:42:20.987686 31005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.981908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46779 (local address 127.27.186.67:58477)
0811 16:42:20.982035 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:20.982047 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:20.982115 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:20.982229 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:20.982230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:20.982464 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:20.982527 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.982530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.983190 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.983192 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.983748 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:20.983750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.984124 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.984125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:20.984182 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.984559 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:20.984563 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:20.984857 (+ 294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:20.986516 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.986517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.986517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.986688 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.986931 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:20.986932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:20.986932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:20.987010 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:20.987313 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:20.987314 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:20.987367 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 16:42:20.987453 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:42:20.987565 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
I20260811 16:42:20.987691 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:20.981958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:58477 (local address 127.27.186.126:46779)
0811 16:42:20.981995 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:20.981997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:20.982101 (+ 104us) server_negotiation.cc:407] Connection header received
0811 16:42:20.982158 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:20.982159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:20.982170 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:20.982222 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:20.982615 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.983074 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.983860 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:20.984039 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:20.984114 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:20.984941 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:20.984942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:20.984943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:20.984948 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:20.986433 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.986793 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.986794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.986794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.986851 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:20.987097 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:20.987098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:20.987099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:20.987234 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:20.987289 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:20.987492 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 16:42:20.987590 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:20.988368 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:42:20 dist-test-slave-gsp7 krb5kdc[30138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:42:21 dist-test-slave-gsp7 krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:21.014669 30286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.007148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56848 (local address 127.27.186.126:46779)
0811 16:42:21.007223 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.007225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.007235 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:21.007270 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.007271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.007281 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.007336 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:21.007911 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.008399 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.009129 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.009308 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.009359 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.012190 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:21.012192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:21.012192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:21.012200 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:21.013646 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:21.013975 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:21.013976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:21.013976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:21.014033 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:21.014214 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:21.014214 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:21.014215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:21.014326 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:21.014442 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.014529 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.014596 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 16:42:21.016389 30207 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:21.018297 30207 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:21.024848 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.020866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43250 (local address 127.27.186.66:46625)
0811 16:42:21.021153 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.021158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.021170 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:42:21.021213 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.021215 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.021231 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.021551 (+ 320us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.021624 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.022450 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.023656 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.024409 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.024492 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.024557 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.024711 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.024751 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":91,"threads_started":1}
I20260811 16:42:21.024833 31025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.020743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46625 (local address 127.0.0.1:43250)
0811 16:42:21.020931 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.020973 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.021043 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.021362 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.021365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.021367 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.021441 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.021443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.022548 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.022549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.023549 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.023552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.024493 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.024494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.024571 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.024585 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.024691 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.024747 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":58,"threads_started":1}
I20260811 16:42:21.025854 31028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.020979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:35867 (local address 127.0.0.1:42438)
0811 16:42:21.021290 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.021302 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.021348 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.021786 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.021787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.021789 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.021825 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.021827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.023220 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.023221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.024202 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.024205 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.025372 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.025373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.025443 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.025448 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.025539 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.025591 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":80,"threads_started":1}
I20260811 16:42:21.025705 30645 tablet_service.cc:1467] Processing CreateTablet for tablet 74f42da459d447d4a57ced57ffaa7a4b (DEFAULT_TABLE table=test-table [id=a723b767292c41178a7071f9878f5156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:21.025970 31026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.020764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40491 (local address 127.0.0.1:34704)
0811 16:42:21.021176 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.021186 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.021232 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.021614 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.021615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.021618 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.021680 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.021682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.023177 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.023178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.024343 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.024346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.025731 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.025732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.025796 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.025800 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.025859 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.025900 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":77,"thread_start_us":93,"threads_started":1}
I20260811 16:42:21.026134 30645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74f42da459d447d4a57ced57ffaa7a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.026154 31029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.021110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42438 (local address 127.27.186.65:35867)
0811 16:42:21.021566 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.021570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.021580 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:21.021623 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.021625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.021642 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.021715 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.021925 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.023116 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.024340 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.025184 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.025261 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.025318 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.025958 (+ 640us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.026012 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":85,"threads_started":1}
I20260811 16:42:21.026286 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.021139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34704 (local address 127.27.186.67:40491)
0811 16:42:21.021365 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.021370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.021381 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:21.021425 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.021428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.021445 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.021766 (+ 321us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.021824 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.023072 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.024440 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.025637 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.025716 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.025777 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.026140 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.026187 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":106,"threads_started":1}
I20260811 16:42:21.027029 30888 tablet_service.cc:1467] Processing CreateTablet for tablet 74f42da459d447d4a57ced57ffaa7a4b (DEFAULT_TABLE table=test-table [id=a723b767292c41178a7071f9878f5156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:21.027029 30435 tablet_service.cc:1467] Processing CreateTablet for tablet 74f42da459d447d4a57ced57ffaa7a4b (DEFAULT_TABLE table=test-table [id=a723b767292c41178a7071f9878f5156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:21.027395 30888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74f42da459d447d4a57ced57ffaa7a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.027397 30435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74f42da459d447d4a57ced57ffaa7a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.029420 31031 tablet_bootstrap.cc:492] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Bootstrap starting.
I20260811 16:42:21.030090 31031 tablet_bootstrap.cc:654] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.030336 31031 log.cc:824] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:21.031026 31031 tablet_bootstrap.cc:492] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: No bootstrap required, opened a new log
I20260811 16:42:21.031072 31031 ts_tablet_manager.cc:1397] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:21.031876 31034 tablet_bootstrap.cc:492] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Bootstrap starting.
I20260811 16:42:21.032416 31036 tablet_bootstrap.cc:492] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Bootstrap starting.
I20260811 16:42:21.033186 31034 tablet_bootstrap.cc:654] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.033241 31031 raft_consensus.cc:348] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.033429 31036 tablet_bootstrap.cc:654] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.033463 31031 raft_consensus.cc:374] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.033552 31031 raft_consensus.cc:729] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea2ad316b4c45369f8696d4cd4e4e0c, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.033684 31034 log.cc:824] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:21.033690 31031 consensus_queue.cc:260] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.033905 31036 log.cc:824] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:21.033982 31031 ts_tablet_manager.cc:1428] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 16:42:21.034374 30762 heartbeater.cc:503] Master 127.27.186.126:46779 was elected leader, sending a full tablet report...
I20260811 16:42:21.034687 31034 tablet_bootstrap.cc:492] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: No bootstrap required, opened a new log
I20260811 16:42:21.034718 31036 tablet_bootstrap.cc:492] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: No bootstrap required, opened a new log
I20260811 16:42:21.034768 31034 ts_tablet_manager.cc:1397] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:42:21.034786 31036 ts_tablet_manager.cc:1397] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:42:21.036537 31036 raft_consensus.cc:348] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.036695 31036 raft_consensus.cc:374] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.036743 31036 raft_consensus.cc:729] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3953aae3b5e4c6aa0821480baf8730c, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.036698 31034 raft_consensus.cc:348] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.036859 31036 consensus_queue.cc:260] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.036918 31034 raft_consensus.cc:374] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.036947 31034 raft_consensus.cc:729] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8861803a8e4b463da6bf132102d38c95, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.037087 31034 consensus_queue.cc:260] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.037142 31036 ts_tablet_manager.cc:1428] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 16:42:21.037170 30997 heartbeater.cc:503] Master 127.27.186.126:46779 was elected leader, sending a full tablet report...
I20260811 16:42:21.037403 31034 ts_tablet_manager.cc:1428] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:42:21.037428 30533 heartbeater.cc:503] Master 127.27.186.126:46779 was elected leader, sending a full tablet report...
W20260811 16:42:21.042253 30765 tablet.cc:2369] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:42:21.126708 30534 tablet.cc:2369] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:42:21.230365 30998 tablet.cc:2369] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:21.326648 31043 raft_consensus.cc:482] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:21.326773 31043 raft_consensus.cc:504] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.327246 31043 leader_election.cc:288] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3953aae3b5e4c6aa0821480baf8730c (127.27.186.67:40491), dea2ad316b4c45369f8696d4cd4e4e0c (127.27.186.66:46625)
I20260811 16:42:21.330821 31045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.327597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46625 (local address 127.27.186.65:52313)
0811 16:42:21.327789 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.327796 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.327863 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.328059 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.328060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.328062 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.328109 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.328111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.329065 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.329066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.329931 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.329934 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.330545 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.330546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.330627 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.330630 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.330702 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.330742 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":88,"threads_started":1}
I20260811 16:42:21.330821 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.327665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:52313 (local address 127.27.186.66:46625)
0811 16:42:21.327712 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.327714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.327855 (+ 141us) server_negotiation.cc:407] Connection header received
0811 16:42:21.327951 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.327964 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.327975 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.328034 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.328188 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.328945 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.330065 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.330435 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.330544 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.330555 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.330709 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.330752 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:42:21.330932 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.327708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:45307 (local address 127.27.186.67:40491)
0811 16:42:21.327767 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.327770 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.327787 (+ 17us) server_negotiation.cc:407] Connection header received
0811 16:42:21.327815 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.327815 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.327823 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.327929 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.328170 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.328945 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.330121 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.330524 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.330619 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.330628 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.330819 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.330860 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:42:21.330981 31044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.327463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40491 (local address 127.27.186.65:45307)
0811 16:42:21.327623 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.327635 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.327699 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.327938 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.327940 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.327943 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.328059 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.328062 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.329060 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.329062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.329993 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.329995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.330620 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.330621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.330731 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.330735 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.330811 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.330853 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":15,"thread_start_us":79,"threads_started":1}
I20260811 16:42:21.331324 30674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74f42da459d447d4a57ced57ffaa7a4b" candidate_uuid: "8861803a8e4b463da6bf132102d38c95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" is_pre_election: true
I20260811 16:42:21.331349 30919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74f42da459d447d4a57ced57ffaa7a4b" candidate_uuid: "8861803a8e4b463da6bf132102d38c95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3953aae3b5e4c6aa0821480baf8730c" is_pre_election: true
I20260811 16:42:21.331506 30674 raft_consensus.cc:2454] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8861803a8e4b463da6bf132102d38c95 in term 0.
I20260811 16:42:21.331503 30919 raft_consensus.cc:2454] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8861803a8e4b463da6bf132102d38c95 in term 0.
I20260811 16:42:21.331763 30349 leader_election.cc:302] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8861803a8e4b463da6bf132102d38c95, dea2ad316b4c45369f8696d4cd4e4e0c; no voters:
I20260811 16:42:21.331969 31043 raft_consensus.cc:2781] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:21.332051 31043 raft_consensus.cc:482] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:21.332084 31043 raft_consensus.cc:3037] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.332880 31043 raft_consensus.cc:504] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.333051 31043 leader_election.cc:288] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [CANDIDATE]: Term 1 election: Requested vote from peers e3953aae3b5e4c6aa0821480baf8730c (127.27.186.67:40491), dea2ad316b4c45369f8696d4cd4e4e0c (127.27.186.66:46625)
I20260811 16:42:21.333220 30919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74f42da459d447d4a57ced57ffaa7a4b" candidate_uuid: "8861803a8e4b463da6bf132102d38c95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3953aae3b5e4c6aa0821480baf8730c"
I20260811 16:42:21.333223 30674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74f42da459d447d4a57ced57ffaa7a4b" candidate_uuid: "8861803a8e4b463da6bf132102d38c95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c"
I20260811 16:42:21.333303 30919 raft_consensus.cc:3037] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.333335 30674 raft_consensus.cc:3037] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.334154 30919 raft_consensus.cc:2454] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8861803a8e4b463da6bf132102d38c95 in term 1.
I20260811 16:42:21.334163 30674 raft_consensus.cc:2454] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8861803a8e4b463da6bf132102d38c95 in term 1.
I20260811 16:42:21.334350 30351 leader_election.cc:302] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8861803a8e4b463da6bf132102d38c95, e3953aae3b5e4c6aa0821480baf8730c; no voters:
I20260811 16:42:21.334447 31043 raft_consensus.cc:2781] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:21.334575 31043 raft_consensus.cc:686] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 1 LEADER]: Becoming Leader. State: Replica: 8861803a8e4b463da6bf132102d38c95, State: Running, Role: LEADER
I20260811 16:42:21.334693 31043 consensus_queue.cc:237] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } }
I20260811 16:42:21.335572 30207 catalog_manager.cc:5495] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8861803a8e4b463da6bf132102d38c95 (127.27.186.65). New cstate: current_term: 1 leader_uuid: "8861803a8e4b463da6bf132102d38c95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } health_report { overall_health: HEALTHY } } }
I20260811 16:42:21.385986 31029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.383138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42442 (local address 127.27.186.65:35867)
0811 16:42:21.383211 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.383213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.383223 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:21.383326 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.383327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.383345 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.383405 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:21.383599 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.384100 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.384952 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.385136 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.385189 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.385427 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:21.385605 (+ 178us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:21.385700 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.385864 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.385886 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:42:21.387858 30919 raft_consensus.cc:1261] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Refusing update from remote peer 8861803a8e4b463da6bf132102d38c95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:21.387882 30674 raft_consensus.cc:1261] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Refusing update from remote peer 8861803a8e4b463da6bf132102d38c95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:21.388288 31047 consensus_queue.cc:1035] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:21.388450 31043 consensus_queue.cc:1035] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:21.391147 31053 mvcc.cc:205] Tried to move back new op lower bound from 7317366953521954816 to 7317366953307492352. Current Snapshot: MvccSnapshot[applied={T|T < 7317366953521954816}]
I20260811 16:42:21.391187 31052 mvcc.cc:205] Tried to move back new op lower bound from 7317366953521954816 to 7317366953307492352. Current Snapshot: MvccSnapshot[applied={T|T < 7317366953521954816}]
I20260811 16:42:21.395121 30205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:21.395296 30205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:21.396286 30205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d: Sending DeleteTablet for 3 replicas of tablet 74f42da459d447d4a57ced57ffaa7a4b
I20260811 16:42:21.396771 30888 tablet_service.cc:1514] Processing DeleteTablet for tablet 74f42da459d447d4a57ced57ffaa7a4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:21 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:34704
I20260811 16:42:21.397305 31068 tablet_replica.cc:330] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: stopping tablet replica
I20260811 16:42:21.397384 31068 raft_consensus.cc:2229] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:21.397464 31068 raft_consensus.cc:2258] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:21.397524 30205 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56848:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:21.397670 30205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:21.397871 31068 ts_tablet_manager.cc:1905] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:21.398458 30435 tablet_service.cc:1514] Processing DeleteTablet for tablet 74f42da459d447d4a57ced57ffaa7a4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:21 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:42438
I20260811 16:42:21.398890 30645 tablet_service.cc:1514] Processing DeleteTablet for tablet 74f42da459d447d4a57ced57ffaa7a4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:21 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:43250
I20260811 16:42:21.399084 31072 tablet_replica.cc:330] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: stopping tablet replica
I20260811 16:42:21.399235 31072 raft_consensus.cc:2229] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:21.399401 31072 raft_consensus.cc:2258] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:21.399541 31070 tablet_replica.cc:330] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: stopping tablet replica
I20260811 16:42:21.399645 31070 raft_consensus.cc:2229] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:21.399813 31068 ts_tablet_manager.cc:1918] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:21.399895 31068 log.cc:1196] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/74f42da459d447d4a57ced57ffaa7a4b
I20260811 16:42:21.400128 31072 ts_tablet_manager.cc:1905] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:21.400272 31068 ts_tablet_manager.cc:1939] T 74f42da459d447d4a57ced57ffaa7a4b P e3953aae3b5e4c6aa0821480baf8730c: Deleting consensus metadata
I20260811 16:42:21.400767 30182 catalog_manager.cc:4841] TS e3953aae3b5e4c6aa0821480baf8730c (127.27.186.67:40491): tablet 74f42da459d447d4a57ced57ffaa7a4b (table test-table [id=a723b767292c41178a7071f9878f5156]) successfully deleted
I20260811 16:42:21.401063 31070 raft_consensus.cc:2258] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:21.401612 31070 ts_tablet_manager.cc:1905] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:21.402474 31072 ts_tablet_manager.cc:1918] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:21.402607 31072 log.cc:1196] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/74f42da459d447d4a57ced57ffaa7a4b
I20260811 16:42:21.402928 31072 ts_tablet_manager.cc:1939] T 74f42da459d447d4a57ced57ffaa7a4b P dea2ad316b4c45369f8696d4cd4e4e0c: Deleting consensus metadata
I20260811 16:42:21.403330 31070 ts_tablet_manager.cc:1918] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:21.403407 31070 log.cc:1196] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/74f42da459d447d4a57ced57ffaa7a4b
I20260811 16:42:21.403471 30178 catalog_manager.cc:4841] TS dea2ad316b4c45369f8696d4cd4e4e0c (127.27.186.66:46625): tablet 74f42da459d447d4a57ced57ffaa7a4b (table test-table [id=a723b767292c41178a7071f9878f5156]) successfully deleted
I20260811 16:42:21.403702 31070 ts_tablet_manager.cc:1939] T 74f42da459d447d4a57ced57ffaa7a4b P 8861803a8e4b463da6bf132102d38c95: Deleting consensus metadata
I20260811 16:42:21.404100 30182 catalog_manager.cc:4841] TS 8861803a8e4b463da6bf132102d38c95 (127.27.186.65:35867): tablet 74f42da459d447d4a57ced57ffaa7a4b (table test-table [id=a723b767292c41178a7071f9878f5156]) successfully deleted
I20260811 16:42:21.404098 30645 tablet_service.cc:1467] Processing CreateTablet for tablet 0f154b5241ed445c8a63c9ee20e2468d (DEFAULT_TABLE table=test-table [id=3defdccc57284dcf8e2bc6a41cf02275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:21.404206 30645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f154b5241ed445c8a63c9ee20e2468d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.404196 30435 tablet_service.cc:1467] Processing CreateTablet for tablet 0f154b5241ed445c8a63c9ee20e2468d (DEFAULT_TABLE table=test-table [id=3defdccc57284dcf8e2bc6a41cf02275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:21.404229 30888 tablet_service.cc:1467] Processing CreateTablet for tablet 0f154b5241ed445c8a63c9ee20e2468d (DEFAULT_TABLE table=test-table [id=3defdccc57284dcf8e2bc6a41cf02275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:21.404304 30435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f154b5241ed445c8a63c9ee20e2468d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.404318 30888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f154b5241ed445c8a63c9ee20e2468d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.405521 31031 tablet_bootstrap.cc:492] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: Bootstrap starting.
I20260811 16:42:21.405594 31036 tablet_bootstrap.cc:492] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: Bootstrap starting.
I20260811 16:42:21.405937 31031 tablet_bootstrap.cc:654] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.405946 31034 tablet_bootstrap.cc:492] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: Bootstrap starting.
I20260811 16:42:21.406049 31036 tablet_bootstrap.cc:654] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.406423 31034 tablet_bootstrap.cc:654] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.406661 31031 tablet_bootstrap.cc:492] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: No bootstrap required, opened a new log
I20260811 16:42:21.406713 31031 ts_tablet_manager.cc:1397] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:21.406849 31031 raft_consensus.cc:348] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.406913 31031 raft_consensus.cc:374] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.406934 31031 raft_consensus.cc:729] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea2ad316b4c45369f8696d4cd4e4e0c, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.406993 31031 consensus_queue.cc:260] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.407155 31034 tablet_bootstrap.cc:492] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: No bootstrap required, opened a new log
I20260811 16:42:21.407186 31034 ts_tablet_manager.cc:1397] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:21.407262 31031 ts_tablet_manager.cc:1428] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:21.407347 31034 raft_consensus.cc:348] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.407424 31034 raft_consensus.cc:374] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.407449 31034 raft_consensus.cc:729] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8861803a8e4b463da6bf132102d38c95, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.407491 31034 consensus_queue.cc:260] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.407591 31034 ts_tablet_manager.cc:1428] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:21.409909 31036 tablet_bootstrap.cc:492] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: No bootstrap required, opened a new log
I20260811 16:42:21.409952 31036 ts_tablet_manager.cc:1397] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 16:42:21.410152 31036 raft_consensus.cc:348] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.410211 31036 raft_consensus.cc:374] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.410225 31036 raft_consensus.cc:729] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3953aae3b5e4c6aa0821480baf8730c, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.410285 31036 consensus_queue.cc:260] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.410391 31036 ts_tablet_manager.cc:1428] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:21.499046 31042 raft_consensus.cc:482] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:21.499161 31042 raft_consensus.cc:504] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.499624 31042 leader_election.cc:288] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8861803a8e4b463da6bf132102d38c95 (127.27.186.65:35867), dea2ad316b4c45369f8696d4cd4e4e0c (127.27.186.66:46625)
I20260811 16:42:21.503235 31078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.499798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:35867 (local address 127.27.186.67:55201)
0811 16:42:21.499955 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.499967 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.500050 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.500246 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.500247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.500251 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.500322 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.500324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.501233 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.501235 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.502340 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.502344 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.502934 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.502936 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.503013 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.503017 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.503098 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.503143 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
I20260811 16:42:21.503219 31029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.499871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:55201 (local address 127.27.186.65:35867)
0811 16:42:21.499933 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.499935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.500026 (+ 91us) server_negotiation.cc:407] Connection header received
0811 16:42:21.500130 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.500131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.500145 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.500173 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.500390 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.501128 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.502452 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.502816 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.502929 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.502940 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.503109 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.503149 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:42:21.503750 30460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f154b5241ed445c8a63c9ee20e2468d" candidate_uuid: "e3953aae3b5e4c6aa0821480baf8730c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8861803a8e4b463da6bf132102d38c95" is_pre_election: true
I20260811 16:42:21.503883 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.499881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46625 (local address 127.27.186.67:38459)
0811 16:42:21.499976 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.499987 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.500040 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.500275 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.500276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.500278 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.500322 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.500327 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.501768 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.501769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.502803 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.502807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.503610 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.503611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.503687 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.503691 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.503743 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.503784 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":64,"threads_started":1}
I20260811 16:42:21.503906 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.500057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:38459 (local address 127.27.186.66:46625)
0811 16:42:21.500103 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.500106 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.500116 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:21.500145 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.500146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.500156 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.500257 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.500931 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.501665 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.502934 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.503481 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.503535 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.503543 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.503773 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.503823 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:42:21.503916 30460 raft_consensus.cc:2454] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3953aae3b5e4c6aa0821480baf8730c in term 0.
I20260811 16:42:21.504144 30674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f154b5241ed445c8a63c9ee20e2468d" candidate_uuid: "e3953aae3b5e4c6aa0821480baf8730c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" is_pre_election: true
I20260811 16:42:21.504240 30674 raft_consensus.cc:2454] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3953aae3b5e4c6aa0821480baf8730c in term 0.
I20260811 16:42:21.504227 30815 leader_election.cc:302] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8861803a8e4b463da6bf132102d38c95, e3953aae3b5e4c6aa0821480baf8730c; no voters:
I20260811 16:42:21.504407 31042 raft_consensus.cc:2781] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:21.504457 31042 raft_consensus.cc:482] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:21.504473 31042 raft_consensus.cc:3037] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.505175 31042 raft_consensus.cc:504] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.505324 31042 leader_election.cc:288] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [CANDIDATE]: Term 1 election: Requested vote from peers 8861803a8e4b463da6bf132102d38c95 (127.27.186.65:35867), dea2ad316b4c45369f8696d4cd4e4e0c (127.27.186.66:46625)
I20260811 16:42:21.505537 30460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f154b5241ed445c8a63c9ee20e2468d" candidate_uuid: "e3953aae3b5e4c6aa0821480baf8730c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8861803a8e4b463da6bf132102d38c95"
I20260811 16:42:21.505543 30674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f154b5241ed445c8a63c9ee20e2468d" candidate_uuid: "e3953aae3b5e4c6aa0821480baf8730c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c"
I20260811 16:42:21.505609 30460 raft_consensus.cc:3037] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.505623 30674 raft_consensus.cc:3037] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.506492 30674 raft_consensus.cc:2454] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3953aae3b5e4c6aa0821480baf8730c in term 1.
I20260811 16:42:21.506675 30813 leader_election.cc:302] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea2ad316b4c45369f8696d4cd4e4e0c, e3953aae3b5e4c6aa0821480baf8730c; no voters:
I20260811 16:42:21.506774 31042 raft_consensus.cc:2781] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:21.506898 31042 raft_consensus.cc:686] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 1 LEADER]: Becoming Leader. State: Replica: e3953aae3b5e4c6aa0821480baf8730c, State: Running, Role: LEADER
I20260811 16:42:21.506899 30460 raft_consensus.cc:2454] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3953aae3b5e4c6aa0821480baf8730c in term 1.
I20260811 16:42:21.506978 31042 consensus_queue.cc:237] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.507813 30205 catalog_manager.cc:5495] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c reported cstate change: term changed from 0 to 1, leader changed from <none> to e3953aae3b5e4c6aa0821480baf8730c (127.27.186.67). New cstate: current_term: 1 leader_uuid: "e3953aae3b5e4c6aa0821480baf8730c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } health_report { overall_health: HEALTHY } } }
Aug 11 16:42:21 dist-test-slave-gsp7 krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:21.557922 31095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.550444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56854 (local address 127.27.186.126:46779)
0811 16:42:21.550535 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.550537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.550551 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:42:21.550688 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.550689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.550702 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.550781 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:21.551345 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.551845 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.552615 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.552815 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.552866 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.555080 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:21.555081 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:21.555082 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:21.555090 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:21.556609 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:21.557020 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:21.557021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:21.557022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:21.557085 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:21.557291 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:21.557292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:21.557292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:21.557409 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:21.557512 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.557684 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.557805 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67,"thread_start_us":43,"threads_started":1}
I20260811 16:42:21.557991 31094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.550319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46779 (local address 127.0.0.1:56854)
0811 16:42:21.550495 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.550506 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.550571 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.550853 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.550854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.551202 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:21.551263 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.551265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.551969 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.551970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.552535 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.552537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.552886 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.552887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.552928 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.553457 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:21.553462 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:21.554974 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:21.556717 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:21.556726 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:21.556729 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:21.556937 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:21.557158 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:21.557159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:21.557159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:21.557223 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:21.557511 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:21.557521 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:21.557569 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.557661 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.557866 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":98,"thread_start_us":98,"threads_started":1}
I20260811 16:42:21.560321 30205 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:56854:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:42:21.560631 30205 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:21.562264 30435 tablet_service.cc:1467] Processing CreateTablet for tablet da9d7af312a14506af2b6cbcf3b6ce31 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2fb00d6132e341ac877880b71f160f8b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:21.562286 30888 tablet_service.cc:1467] Processing CreateTablet for tablet da9d7af312a14506af2b6cbcf3b6ce31 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2fb00d6132e341ac877880b71f160f8b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:21.562290 30645 tablet_service.cc:1467] Processing CreateTablet for tablet da9d7af312a14506af2b6cbcf3b6ce31 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2fb00d6132e341ac877880b71f160f8b]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:21.562463 30888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da9d7af312a14506af2b6cbcf3b6ce31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.562469 30435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da9d7af312a14506af2b6cbcf3b6ce31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.562471 30645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da9d7af312a14506af2b6cbcf3b6ce31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:21.565138 31034 tablet_bootstrap.cc:492] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: Bootstrap starting.
I20260811 16:42:21.565181 31031 tablet_bootstrap.cc:492] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: Bootstrap starting.
I20260811 16:42:21.565176 31036 tablet_bootstrap.cc:492] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: Bootstrap starting.
I20260811 16:42:21.565601 31034 tablet_bootstrap.cc:654] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.565727 31031 tablet_bootstrap.cc:654] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.565773 31036 tablet_bootstrap.cc:654] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:21.566488 31031 tablet_bootstrap.cc:492] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: No bootstrap required, opened a new log
I20260811 16:42:21.566548 31031 ts_tablet_manager.cc:1397] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:21.566628 31036 tablet_bootstrap.cc:492] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: No bootstrap required, opened a new log
I20260811 16:42:21.566682 31036 ts_tablet_manager.cc:1397] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:42:21.566699 31034 tablet_bootstrap.cc:492] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: No bootstrap required, opened a new log
I20260811 16:42:21.566746 31034 ts_tablet_manager.cc:1397] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:42:21.566715 31031 raft_consensus.cc:348] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.566797 31031 raft_consensus.cc:374] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.566818 31031 raft_consensus.cc:729] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea2ad316b4c45369f8696d4cd4e4e0c, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.566861 31031 consensus_queue.cc:260] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.566855 31034 raft_consensus.cc:348] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.566864 31036 raft_consensus.cc:348] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.566923 31034 raft_consensus.cc:374] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.566948 31036 raft_consensus.cc:374] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:21.566946 31034 raft_consensus.cc:729] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8861803a8e4b463da6bf132102d38c95, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.566960 31031 ts_tablet_manager.cc:1428] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:21.566972 31036 raft_consensus.cc:729] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3953aae3b5e4c6aa0821480baf8730c, State: Initialized, Role: FOLLOWER
I20260811 16:42:21.567005 31034 consensus_queue.cc:260] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.567011 31036 consensus_queue.cc:260] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.567101 31036 ts_tablet_manager.cc:1428] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:21.567101 31034 ts_tablet_manager.cc:1428] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:21.567049 31038 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.567154 31038 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:21.567167 31058 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.567289 31058 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:21.567394 31081 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.567484 31081 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:21.724890 31038 raft_consensus.cc:482] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:21.725004 31038 raft_consensus.cc:504] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.725414 31038 leader_election.cc:288] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8861803a8e4b463da6bf132102d38c95 (127.27.186.65:35867), e3953aae3b5e4c6aa0821480baf8730c (127.27.186.67:40491)
I20260811 16:42:21.729377 31029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.725768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:43123 (local address 127.27.186.65:35867)
0811 16:42:21.725830 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.725837 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.725957 (+ 120us) server_negotiation.cc:407] Connection header received
0811 16:42:21.726096 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.726098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.726111 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.726185 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.726468 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.727230 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.728387 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.728965 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.729045 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.729054 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.729254 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.729301 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:42:21.729413 31099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.725694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:35867 (local address 127.27.186.66:43123)
0811 16:42:21.725875 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.725887 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.725956 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.726234 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.726235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.726238 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.726331 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.726334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.727339 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.727340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.728289 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.728292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.729090 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.729091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.729163 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.729168 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.729216 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.729247 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":2,"thread_start_us":116,"threads_started":1}
I20260811 16:42:21.729460 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.726022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:41073 (local address 127.27.186.67:40491)
0811 16:42:21.726107 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.726109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.726177 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:42:21.726274 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.726275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.726285 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.726348 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:21.726537 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.727220 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.728462 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.728986 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.729046 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.729054 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.729327 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.729381 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:42:21.729421 31100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.725937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40491 (local address 127.27.186.66:41073)
0811 16:42:21.726093 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.726104 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.726175 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.726370 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.726371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.726373 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:21.726470 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.726472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.727327 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.727328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.728385 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.728388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.729091 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.729092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.729185 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.729189 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.729274 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.729312 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":57,"thread_start_us":96,"threads_started":1}
I20260811 16:42:21.729744 30460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da9d7af312a14506af2b6cbcf3b6ce31" candidate_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8861803a8e4b463da6bf132102d38c95" is_pre_election: true
I20260811 16:42:21.729846 30460 raft_consensus.cc:2454] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea2ad316b4c45369f8696d4cd4e4e0c in term 0.
I20260811 16:42:21.730091 30571 leader_election.cc:302] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8861803a8e4b463da6bf132102d38c95, dea2ad316b4c45369f8696d4cd4e4e0c; no voters:
I20260811 16:42:21.730077 30919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da9d7af312a14506af2b6cbcf3b6ce31" candidate_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3953aae3b5e4c6aa0821480baf8730c" is_pre_election: true
I20260811 16:42:21.730189 30919 raft_consensus.cc:2454] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea2ad316b4c45369f8696d4cd4e4e0c in term 0.
I20260811 16:42:21.730268 31038 raft_consensus.cc:2781] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:21.730315 31038 raft_consensus.cc:482] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:21.730334 31038 raft_consensus.cc:3037] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.731230 31038 raft_consensus.cc:504] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.731374 31038 leader_election.cc:288] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [CANDIDATE]: Term 1 election: Requested vote from peers 8861803a8e4b463da6bf132102d38c95 (127.27.186.65:35867), e3953aae3b5e4c6aa0821480baf8730c (127.27.186.67:40491)
I20260811 16:42:21.731554 30460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da9d7af312a14506af2b6cbcf3b6ce31" candidate_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8861803a8e4b463da6bf132102d38c95"
I20260811 16:42:21.731552 30919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da9d7af312a14506af2b6cbcf3b6ce31" candidate_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3953aae3b5e4c6aa0821480baf8730c"
I20260811 16:42:21.731645 30460 raft_consensus.cc:3037] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.731644 30919 raft_consensus.cc:3037] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:21.732300 30919 raft_consensus.cc:2454] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea2ad316b4c45369f8696d4cd4e4e0c in term 1.
I20260811 16:42:21.732442 30460 raft_consensus.cc:2454] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea2ad316b4c45369f8696d4cd4e4e0c in term 1.
I20260811 16:42:21.732475 30571 leader_election.cc:302] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea2ad316b4c45369f8696d4cd4e4e0c, e3953aae3b5e4c6aa0821480baf8730c; no voters:
I20260811 16:42:21.732555 31038 raft_consensus.cc:2781] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:21.732699 31038 raft_consensus.cc:686] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 LEADER]: Becoming Leader. State: Replica: dea2ad316b4c45369f8696d4cd4e4e0c, State: Running, Role: LEADER
I20260811 16:42:21.732798 31038 consensus_queue.cc:237] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } }
I20260811 16:42:21.733214 31102 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: TxnStatusTablet state changed. Reason: New leader dea2ad316b4c45369f8696d4cd4e4e0c. Latest consensus state: current_term: 1 leader_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.733385 31102 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:21.733623 31106 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:42:21.733767 31106 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:42:21.733786 30207 catalog_manager.cc:5495] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c reported cstate change: term changed from 0 to 1, leader changed from <none> to dea2ad316b4c45369f8696d4cd4e4e0c (127.27.186.66). New cstate: current_term: 1 leader_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } health_report { overall_health: UNKNOWN } } }
I20260811 16:42:21.749465 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.746472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43258 (local address 127.27.186.66:46625)
0811 16:42:21.746542 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.746545 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.746588 (+ 43us) server_negotiation.cc:407] Connection header received
0811 16:42:21.746688 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.746689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.746710 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.746784 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:21.746914 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.747677 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.748477 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.748783 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.748856 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.749058 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:21.749176 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:21.749254 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.749338 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.749367 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:42:21.749440 31094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.746378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46625 (local address 127.0.0.1:43258)
0811 16:42:21.746540 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.746552 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.746606 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.746798 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.746799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.746800 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:21.746852 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.746855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.747790 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.747791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.748387 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.748389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.748886 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.748887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.748939 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.748955 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:21.749263 (+ 308us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:21.749272 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.749334 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.749382 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260811 16:42:21.750914 30919 raft_consensus.cc:1261] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Refusing update from remote peer dea2ad316b4c45369f8696d4cd4e4e0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:21.751061 30460 raft_consensus.cc:1261] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Refusing update from remote peer dea2ad316b4c45369f8696d4cd4e4e0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:21.751216 31038 consensus_queue.cc:1035] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:21.751374 31102 consensus_queue.cc:1035] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:21.752043 31058 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: TxnStatusTablet state changed. Reason: New leader dea2ad316b4c45369f8696d4cd4e4e0c. Latest consensus state: current_term: 1 leader_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.752154 31058 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:21.752391 31081 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: TxnStatusTablet state changed. Reason: New leader dea2ad316b4c45369f8696d4cd4e4e0c. Latest consensus state: current_term: 1 leader_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.752508 31081 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:21.753262 31102 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.753381 31102 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:21.753269 31038 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.753545 31081 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.753615 31038 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P dea2ad316b4c45369f8696d4cd4e4e0c: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:21.753628 31081 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P e3953aae3b5e4c6aa0821480baf8730c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:21.754029 31051 mvcc.cc:205] Tried to move back new op lower bound from 7317366955009298432 to 7317366954938056704. Current Snapshot: MvccSnapshot[applied={T|T < 7317366955009298432}]
I20260811 16:42:21.754146 31058 tablet_replica.cc:439] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 } } peers { permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 } } peers { permanent_uuid: "e3953aae3b5e4c6aa0821480baf8730c" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40491 } } }
I20260811 16:42:21.754213 31058 tablet_replica.cc:442] T da9d7af312a14506af2b6cbcf3b6ce31 P 8861803a8e4b463da6bf132102d38c95: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:21.757696 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.755278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34716 (local address 127.27.186.67:40491)
0811 16:42:21.755314 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.755316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.755344 (+ 28us) server_negotiation.cc:407] Connection header received
0811 16:42:21.755432 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.755433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.755453 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.755540 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:21.755654 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.756116 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.756850 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.757061 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.757139 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.757328 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:21.757435 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:21.757542 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.757599 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.757619 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:21.763006 31027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.760404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:33981 (local address 127.27.186.66:46625)
0811 16:42:21.760447 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.760449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.760459 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:21.760482 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.760483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.760492 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.760557 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:21.760651 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.761375 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.762215 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.762541 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.762616 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.762773 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:21.762809 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:21.762865 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.762918 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.762937 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:42:21.763199 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.760216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46625 (local address 127.27.186.67:33981)
0811 16:42:21.760376 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.760387 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.760440 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.760558 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.760559 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.760560 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:21.760607 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.760608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.761460 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.761461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.762125 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.762127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.762632 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.762633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.762677 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.762691 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:21.762879 (+ 188us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:21.762881 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.762915 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.762948 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260811 16:42:21.765733 30460 raft_consensus.cc:1261] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Refusing update from remote peer e3953aae3b5e4c6aa0821480baf8730c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:21.765735 30674 raft_consensus.cc:1261] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Refusing update from remote peer e3953aae3b5e4c6aa0821480baf8730c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:21.765998 31081 consensus_queue.cc:1035] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8861803a8e4b463da6bf132102d38c95" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 35867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:21.766139 31042 consensus_queue.cc:1035] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea2ad316b4c45369f8696d4cd4e4e0c" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:21.775740 31132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.772689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40491 (local address 127.27.186.66:44975)
0811 16:42:21.772893 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:21.772903 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:21.772958 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:21.773126 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:21.773127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:21.773128 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:21.773216 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.773217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.774153 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.774154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.774899 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:21.774902 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.775260 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.775261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:21.775326 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.775358 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:21.775563 (+ 205us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:21.775565 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:42:21.775609 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 16:42:21.775652 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":103,"threads_started":1}
I20260811 16:42:21.775722 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.772728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:44975 (local address 127.27.186.67:40491)
0811 16:42:21.772856 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.772858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.772945 (+ 87us) server_negotiation.cc:407] Connection header received
0811 16:42:21.773007 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.773007 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.773018 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.773066 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:21.773291 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.774070 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.774974 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.775181 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.775262 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.775452 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:21.775489 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:21.775540 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.775612 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.775632 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 16:42:21.786474 30205 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:21.786592 30205 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56848:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:21.787312 30205 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0478970bff98401398fe56bd9a73212d: Sending DeleteTablet for 3 replicas of tablet 0f154b5241ed445c8a63c9ee20e2468d
I20260811 16:42:21.787755 30435 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f154b5241ed445c8a63c9ee20e2468d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:21 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:42438
I20260811 16:42:21.787861 30888 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f154b5241ed445c8a63c9ee20e2468d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:21 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:34704
I20260811 16:42:21.787943 31070 tablet_replica.cc:330] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: stopping tablet replica
I20260811 16:42:21.788004 31070 raft_consensus.cc:2229] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:21.788039 31070 raft_consensus.cc:2258] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:21.788103 31068 tablet_replica.cc:330] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: stopping tablet replica
I20260811 16:42:21.788144 31068 raft_consensus.cc:2229] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:21.788252 31068 raft_consensus.cc:2258] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:21.788465 30645 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f154b5241ed445c8a63c9ee20e2468d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:21 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:43250
I20260811 16:42:21.788566 31072 tablet_replica.cc:330] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: stopping tablet replica
I20260811 16:42:21.788625 31072 raft_consensus.cc:2229] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:21.788663 31072 raft_consensus.cc:2258] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:21.788692 31068 ts_tablet_manager.cc:1905] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:21.788692 31070 ts_tablet_manager.cc:1905] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:21.790659 31068 ts_tablet_manager.cc:1918] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:21.790715 31068 log.cc:1196] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/0f154b5241ed445c8a63c9ee20e2468d
I20260811 16:42:21.790720 31072 ts_tablet_manager.cc:1905] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:21.790939 31068 ts_tablet_manager.cc:1939] T 0f154b5241ed445c8a63c9ee20e2468d P e3953aae3b5e4c6aa0821480baf8730c: Deleting consensus metadata
I20260811 16:42:21.791456 30182 catalog_manager.cc:4841] TS e3953aae3b5e4c6aa0821480baf8730c (127.27.186.67:40491): tablet 0f154b5241ed445c8a63c9ee20e2468d (table test-table [id=3defdccc57284dcf8e2bc6a41cf02275]) successfully deleted
I20260811 16:42:21.792543 31072 ts_tablet_manager.cc:1918] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:21.792596 31072 log.cc:1196] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/0f154b5241ed445c8a63c9ee20e2468d
I20260811 16:42:21.792806 31072 ts_tablet_manager.cc:1939] T 0f154b5241ed445c8a63c9ee20e2468d P dea2ad316b4c45369f8696d4cd4e4e0c: Deleting consensus metadata
Aug 11 16:42:21 dist-test-slave-gsp7 krb5kdc[30138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466540, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:21.797389 31070 ts_tablet_manager.cc:1918] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:21.797456 31070 log.cc:1196] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/0f154b5241ed445c8a63c9ee20e2468d
I20260811 16:42:21.797708 31070 ts_tablet_manager.cc:1939] T 0f154b5241ed445c8a63c9ee20e2468d P 8861803a8e4b463da6bf132102d38c95: Deleting consensus metadata
I20260811 16:42:21.798060 30182 catalog_manager.cc:4841] TS 8861803a8e4b463da6bf132102d38c95 (127.27.186.65:35867): tablet 0f154b5241ed445c8a63c9ee20e2468d (table test-table [id=3defdccc57284dcf8e2bc6a41cf02275]) successfully deleted
I20260811 16:42:21.798403 30178 catalog_manager.cc:4841] TS dea2ad316b4c45369f8696d4cd4e4e0c (127.27.186.66:46625): tablet 0f154b5241ed445c8a63c9ee20e2468d (table test-table [id=3defdccc57284dcf8e2bc6a41cf02275]) successfully deleted
I20260811 16:42:21.799896 31029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.788830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42444 (local address 127.27.186.65:35867)
0811 16:42:21.788873 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.788875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.789133 (+ 258us) server_negotiation.cc:407] Connection header received
0811 16:42:21.789234 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.789235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.789246 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.789276 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:21.790158 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.790909 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.791995 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.792289 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.792346 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.796277 (+ 3931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:21.796290 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:21.796291 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:21.796312 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:21.798450 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:21.798918 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:21.798922 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:21.798922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:21.799004 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:21.799265 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:21.799266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:21.799266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:21.799472 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:21.799628 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.799714 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.799802 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:42:21.800220 30521 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42444
I20260811 16:42:21.809847 31095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:21.801848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56868 (local address 127.27.186.126:46779)
0811 16:42:21.801900 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:21.801902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:21.802046 (+ 144us) server_negotiation.cc:407] Connection header received
0811 16:42:21.802085 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:21.802086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:21.802103 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:21.802174 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:21.802887 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.803689 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.804765 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:21.805110 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:21.805190 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:21.806735 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:21.806737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:21.806737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:21.806745 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:21.808538 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:21.808941 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:21.808942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:21.808942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:21.809015 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:21.809237 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:21.809238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:21.809238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:21.809380 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:21.809550 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:21.809647 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 16:42:21.809746 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 16:42:21.810402 30205 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56868
I20260811 16:42:21.811175 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30321
I20260811 16:42:21.834659 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30546
I20260811 16:42:21.847851 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30784
I20260811 16:42:21.863348 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30154
2026-08-11T16:42:21Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3043 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:21 dist-test-slave-gsp7 krb5kdc[31144](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:21 dist-test-slave-gsp7 krb5kdc[31144](info): set up 2 sockets
Aug 11 16:42:21 dist-test-slave-gsp7 krb5kdc[31144](info): commencing operation
krb5kdc: starting...
W20260811 16:42:23.159709 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:23.297247 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35219
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:35219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:23.381603 31175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:23.381899 31175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:23.381944 31175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:23.383141 31175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:23.383226 31175 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:42:23.383255 31175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:23.383285 31175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:23.383306 31175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:23.383327 31175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:23.384853 31175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:35219
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:23.385212 31175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:23.385525 31175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:42:23.390722 31175 server_base.cc:1034] running on GCE node
W20260811 16:42:23.390655 31185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:23.390620 31182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:23.390619 31188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:23.391252 31175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:23.391580 31175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:23.392761 31175 hybrid_clock.cc:648] HybridClock initialized: now 1786466543392745 us; error 36 us; skew 500 ppm
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:23.395614 31175 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:23.396195 31175 webserver.cc:460] Webserver started at http://127.27.186.126:34241/ using document root <none> and password file <none>
I20260811 16:42:23.396474 31175 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:23.396555 31175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:23.396723 31175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:23.398109 31175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "58f9dc455c4d4d958288b339881a29dc"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "fcc119fd27eb9592d55193282748e118"
server_key_iv: "f237843c2a6948e5127b8798dbc6033f"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.398520 31175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "58f9dc455c4d4d958288b339881a29dc"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "fcc119fd27eb9592d55193282748e118"
server_key_iv: "f237843c2a6948e5127b8798dbc6033f"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.400003 31175 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:23.400880 31208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:23.401079 31175 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:23.401208 31175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "58f9dc455c4d4d958288b339881a29dc"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "fcc119fd27eb9592d55193282748e118"
server_key_iv: "f237843c2a6948e5127b8798dbc6033f"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.401301 31175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:23.415676 31175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:23.418238 31175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:23.418435 31175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:23.423695 31175 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:35219
I20260811 16:42:23.423763 31298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:35219 every 8 connection(s)
I20260811 16:42:23.424101 31175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:23.424721 31299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:23.427242 31299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: Bootstrap starting.
I20260811 16:42:23.427868 31299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:23.428201 31299 log.cc:824] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:23.428949 31299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: No bootstrap required, opened a new log
I20260811 16:42:23.431249 31299 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f9dc455c4d4d958288b339881a29dc" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35219 } }
I20260811 16:42:23.431428 31299 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:23.431479 31299 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58f9dc455c4d4d958288b339881a29dc, State: Initialized, Role: FOLLOWER
I20260811 16:42:23.431620 31299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f9dc455c4d4d958288b339881a29dc" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35219 } }
I20260811 16:42:23.431710 31299 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:23.431756 31299 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:23.431806 31299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:23.432361 31299 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f9dc455c4d4d958288b339881a29dc" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35219 } }
I20260811 16:42:23.432492 31299 leader_election.cc:302] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58f9dc455c4d4d958288b339881a29dc; no voters:
I20260811 16:42:23.432677 31299 leader_election.cc:288] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:23.432729 31305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:23.432926 31305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [term 1 LEADER]: Becoming Leader. State: Replica: 58f9dc455c4d4d958288b339881a29dc, State: Running, Role: LEADER
I20260811 16:42:23.432958 31299 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:23.433032 31305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f9dc455c4d4d958288b339881a29dc" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35219 } }
I20260811 16:42:23.433073 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31175
I20260811 16:42:23.433151 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:23.433344 28393 external_mini_cluster.cc:1428] Setting key d6eb33d70dc1bfb8ff7bb9020d62cb32
I20260811 16:42:23.433470 31305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58f9dc455c4d4d958288b339881a29dc. Latest consensus state: current_term: 1 leader_uuid: "58f9dc455c4d4d958288b339881a29dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f9dc455c4d4d958288b339881a29dc" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35219 } } }
I20260811 16:42:23.433568 31305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:23.433727 31309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58f9dc455c4d4d958288b339881a29dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f9dc455c4d4d958288b339881a29dc" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35219 } } }
I20260811 16:42:23.433785 31309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:23.434386 31316 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:23.435177 31316 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:23.437953 31316 catalog_manager.cc:1347] Generated new cluster ID: ba4b4a97a761468c8344593c202c080d
I20260811 16:42:23.438012 31316 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:23.445582 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.434086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57914 (local address 127.27.186.126:35219)
0811 16:42:23.434360 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:23.434371 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:23.434411 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:42:23.434546 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:23.434553 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:23.434613 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:23.434774 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:23.435584 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.436961 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.437891 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.438516 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.438607 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.441731 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:23.441735 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:23.441735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:23.441747 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:23.443746 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.444247 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.444250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.444250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.444365 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.444601 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.444602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.444602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.444896 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:23.445034 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:23.445185 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 16:42:23.445316 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":79,"threads_started":1}
I20260811 16:42:23.459831 31316 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:23.460417 31316 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:23.468144 31316 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: Generated new TSK 0
I20260811 16:42:23.468348 31316 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:23.501863 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35219
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:23.588141 31337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:23.588341 31337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:23.588367 31337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:23.589460 31337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:23.589538 31337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:23.589560 31337 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:42:23.589579 31337 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:23.589597 31337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:23.591020 31337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:23.591205 31337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:23.591374 31337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:23.596746 31347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:23.596762 31337 server_base.cc:1034] running on GCE node
W20260811 16:42:23.596712 31350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:23.596712 31355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:23.597194 31337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:23.597530 31337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:23.598716 31337 hybrid_clock.cc:648] HybridClock initialized: now 1786466543598695 us; error 42 us; skew 500 ppm
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:23.601575 31337 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:23.602074 31337 webserver.cc:460] Webserver started at http://127.27.186.65:42919/ using document root <none> and password file <none>
I20260811 16:42:23.602342 31337 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:23.602419 31337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:23.602581 31337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:23.603690 31337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "7a2dd5a320ab4e9ab593166f03176618"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "d4cc8aacd5377dd7b5f7e985d0a5cd06"
server_key_iv: "578c8e50a94f600d16de44468c4e7e8f"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.604144 31337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "7a2dd5a320ab4e9ab593166f03176618"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "d4cc8aacd5377dd7b5f7e985d0a5cd06"
server_key_iv: "578c8e50a94f600d16de44468c4e7e8f"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.605728 31337 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:23.606644 31371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:23.606838 31337 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:23.606936 31337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "7a2dd5a320ab4e9ab593166f03176618"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "d4cc8aacd5377dd7b5f7e985d0a5cd06"
server_key_iv: "578c8e50a94f600d16de44468c4e7e8f"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.607023 31337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:23.619536 31337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:23.621778 31337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:23.621950 31337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:23.622484 31337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:23.622551 31337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:23.622597 31337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:23.622624 31337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:23.630728 31337 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:45535
I20260811 16:42:23.630833 31557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:45535 every 8 connection(s)
I20260811 16:42:23.631148 31337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:23.634238 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.623217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:56189 (local address 127.27.186.126:35219)
0811 16:42:23.623295 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:23.623298 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:23.623505 (+ 207us) server_negotiation.cc:407] Connection header received
0811 16:42:23.624038 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:23.624039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:23.624059 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:23.624132 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:23.624830 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.625695 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.626821 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.627050 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.627154 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.630839 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:23.630841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:23.630841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:23.630851 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:23.632668 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.633203 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.633204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.633205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.633265 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.633547 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.633548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.633549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.633709 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:23.633786 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:23.634077 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 16:42:23.634170 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:42:23.634519 31387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.623129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35219 (local address 127.27.186.65:56189)
0811 16:42:23.623362 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:23.623404 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:23.623930 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:23.624219 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:23.624223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:23.624489 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:23.624681 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.624686 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.625821 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.625822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.626664 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.626666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.627166 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.627168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.627320 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.627903 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:23.627916 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:23.630672 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:23.632776 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.632783 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.632785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.633102 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.633325 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.633325 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.633326 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.633423 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.633808 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:23.633814 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:23.633935 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 16:42:23.634029 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 16:42:23.634212 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":130,"threads_started":1}
I20260811 16:42:23.635057 31559 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35219
I20260811 16:42:23.635177 31559 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:23.635365 31559 heartbeater.cc:511] Master 127.27.186.126:35219 requested a full tablet report, sending...
I20260811 16:42:23.635936 31231 ts_manager.cc:194] Registered new tserver with Master: 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535)
I20260811 16:42:23.636677 31231 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:56189
I20260811 16:42:23.638303 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31337
I20260811 16:42:23.638389 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:23.638607 28393 external_mini_cluster.cc:1428] Setting key fee6a086ff1d57fd9fddc3affa8fe72c
I20260811 16:42:23.642946 31567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.636191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35219 (local address 127.27.186.65:48639)
0811 16:42:23.636363 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:23.636379 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:23.636456 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:23.636584 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:23.636585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:23.636814 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:23.636892 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.636894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.637829 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.637830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.638397 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.638400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.638788 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.638789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.638877 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.639426 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:23.639431 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:23.639732 (+ 301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:23.641790 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.641791 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.641791 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.642016 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.642267 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.642268 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.642269 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.642337 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.642656 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:23.642657 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:23.642703 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 16:42:23.642766 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:42:23.642870 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":73,"threads_started":1}
I20260811 16:42:23.643046 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.636276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:48639 (local address 127.27.186.126:35219)
0811 16:42:23.636322 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:23.636324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:23.636439 (+ 115us) server_negotiation.cc:407] Connection header received
0811 16:42:23.636515 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:23.636516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:23.636526 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:23.636571 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:23.636998 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.637736 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.638484 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.638716 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.638787 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.639827 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:23.639829 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:23.639829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:23.639837 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:23.641677 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.642109 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.642111 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.642111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.642181 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.642427 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.642428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.642428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.642573 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:23.642655 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:23.642822 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 16:42:23.642918 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:23.670001 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35219
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:23.757099 31572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:23.757323 31572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:23.757350 31572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:23.758505 31572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:23.758548 31572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:23.758567 31572 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:42:23.758579 31572 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:23.758596 31572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:23.760011 31572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:23.760210 31572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:23.760408 31572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:23.765930 31582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:23.765942 31572 server_base.cc:1034] running on GCE node
W20260811 16:42:23.765904 31588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:23.765894 31584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:23.766373 31572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:23.766592 31572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:23.767778 31572 hybrid_clock.cc:648] HybridClock initialized: now 1786466543767769 us; error 46 us; skew 500 ppm
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:23.770596 31572 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:23.771097 31572 webserver.cc:460] Webserver started at http://127.27.186.66:43887/ using document root <none> and password file <none>
I20260811 16:42:23.771365 31572 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:23.771421 31572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:23.771562 31572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:23.772687 31572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "bf421d7eb0ab44d194bcfff49a1848f8"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "57a870ca17a8d9dfa35a0eb6e70921dc"
server_key_iv: "ac6381b8d44f9db09d5cdadfc35bb2e6"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.773070 31572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "bf421d7eb0ab44d194bcfff49a1848f8"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "57a870ca17a8d9dfa35a0eb6e70921dc"
server_key_iv: "ac6381b8d44f9db09d5cdadfc35bb2e6"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.774588 31572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:23.775396 31597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:23.775625 31572 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:23.775741 31572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "bf421d7eb0ab44d194bcfff49a1848f8"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "57a870ca17a8d9dfa35a0eb6e70921dc"
server_key_iv: "ac6381b8d44f9db09d5cdadfc35bb2e6"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.775821 31572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:23.812484 31572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:23.815143 31572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:23.815316 31572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:23.815912 31572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:23.815959 31572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:23.815984 31572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:23.815996 31572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:23.823472 31572 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:36069
I20260811 16:42:23.823578 31796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:36069 every 8 connection(s)
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:23.823947 31572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:23.826377 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31572
I20260811 16:42:23.826511 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:23.826706 28393 external_mini_cluster.cc:1428] Setting key 7d825ae03d82f3f58970249ccd230bf6
I20260811 16:42:23.827595 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.816609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:40651 (local address 127.27.186.126:35219)
0811 16:42:23.816671 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:23.816674 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:23.816944 (+ 270us) server_negotiation.cc:407] Connection header received
0811 16:42:23.817590 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:23.817593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:23.817609 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:23.817687 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:23.818686 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.819529 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.821160 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.821539 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.821623 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.824503 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:23.824505 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:23.824505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:23.824514 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:23.825900 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.826363 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.826364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.826365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.826436 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.826742 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.826744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.826744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.826929 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:23.827022 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:23.827408 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 16:42:23.827510 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:42:23.827867 31609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.816583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35219 (local address 127.27.186.66:40651)
0811 16:42:23.816785 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:23.816824 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:23.817401 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:23.817828 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:23.817834 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:23.818247 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:23.818587 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.818594 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.819628 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.819630 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.821036 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.821039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.821642 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.821643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.821755 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.822386 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:23.822396 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:23.824403 (+ 2007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:23.826000 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.826008 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.826011 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.826268 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.826514 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.826515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.826515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.826650 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.827038 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:23.827047 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:23.827219 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 16:42:23.827351 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 16:42:23.827572 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":115,"threads_started":1}
I20260811 16:42:23.829873 31797 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35219
I20260811 16:42:23.829988 31797 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:23.830228 31797 heartbeater.cc:511] Master 127.27.186.126:35219 requested a full tablet report, sending...
I20260811 16:42:23.830741 31230 ts_manager.cc:194] Registered new tserver with Master: bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069)
I20260811 16:42:23.831290 31230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:40651
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
I20260811 16:42:23.838104 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.831100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:42055 (local address 127.27.186.126:35219)
0811 16:42:23.831145 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:23.831147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:23.831329 (+ 182us) server_negotiation.cc:407] Connection header received
0811 16:42:23.831404 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:23.831406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:23.831415 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:23.831473 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:23.832000 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.832591 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.833818 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.834033 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.834153 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.835252 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:23.835253 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:23.835253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:23.835262 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:23.836736 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.837130 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.837132 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.837132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.837194 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.837418 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.837419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.837419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.837654 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:23.837736 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:23.837921 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 16:42:23.838003 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:23.838131 31807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.831067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35219 (local address 127.27.186.66:42055)
0811 16:42:23.831253 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:23.831263 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:23.831344 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:23.831613 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:23.831614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:23.831836 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:23.831894 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.831896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.832696 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.832697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.833710 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.833713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.834149 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.834150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.834235 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.834775 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:23.834779 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:23.835159 (+ 380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:23.836839 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.836840 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.836840 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.837047 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.837277 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.837278 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.837278 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.837343 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.837739 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:23.837740 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:23.837791 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 16:42:23.837878 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:42:23.838007 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":134,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:23.856878 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35219
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:23.945451 31809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:23.945815 31809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:23.945863 31809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:23.947053 31809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:23.947095 31809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:23.947116 31809 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 16:42:23.947129 31809 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:23.947144 31809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:23.948598 31809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:23.948802 31809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:23.948992 31809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:23.954746 31827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:23.954735 31820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:23.955001 31809 server_base.cc:1034] running on GCE node
W20260811 16:42:23.954809 31817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:23.955229 31809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:23.955463 31809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:23.956619 31809 hybrid_clock.cc:648] HybridClock initialized: now 1786466543956605 us; error 31 us; skew 500 ppm
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:23.959426 31809 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:23.959913 31809 webserver.cc:460] Webserver started at http://127.27.186.67:42031/ using document root <none> and password file <none>
I20260811 16:42:23.960122 31809 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:23.960165 31809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:23.960258 31809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:23.961314 31809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "aab8459601b444f285b4835da122407d"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "972d80081adc0026c9aa4c6d5966cdf5"
server_key_iv: "adbc49de4f96f5d4e60140db55f54a03"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.961725 31809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "aab8459601b444f285b4835da122407d"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "972d80081adc0026c9aa4c6d5966cdf5"
server_key_iv: "adbc49de4f96f5d4e60140db55f54a03"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.963625 31809 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260811 16:42:23.964723 31840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:23.964943 31809 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:23.965045 31809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "aab8459601b444f285b4835da122407d"
format_stamp: "Formatted at 2026-08-11 16:42:23 on dist-test-slave-gsp7"
server_key: "972d80081adc0026c9aa4c6d5966cdf5"
server_key_iv: "adbc49de4f96f5d4e60140db55f54a03"
server_key_version: "encryptionkey@0"
I20260811 16:42:23.965126 31809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:23.986726 31809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:23.989234 31809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:23.989363 31809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:23.989993 31809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:23.990072 31809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:23.990103 31809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:23.990124 31809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:42:23 dist-test-slave-gsp7 krb5kdc[31144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:23.997957 31809 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:45635
I20260811 16:42:23.998273 32031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:45635 every 8 connection(s)
I20260811 16:42:23.998431 31809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:24.000490 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.990568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:47923 (local address 127.27.186.126:35219)
0811 16:42:23.990651 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:23.990654 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:23.990895 (+ 241us) server_negotiation.cc:407] Connection header received
0811 16:42:23.991537 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:23.991539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:23.991553 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:23.991644 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:23.992597 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.993504 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.994630 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.994826 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.994919 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.997639 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:23.997640 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:23.997641 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:23.997648 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:23.999249 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.999688 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.999688 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.999689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:23.999745 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:23.999957 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:23.999958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:23.999958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:24.000060 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:24.000111 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.000360 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.000425 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 16:42:24.000648 31855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:23.990545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35219 (local address 127.27.186.67:47923)
0811 16:42:23.990733 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:23.990775 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:23.991393 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:23.991756 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:23.991760 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:23.992147 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:23.992470 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.992477 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.993615 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.993616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.994506 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:23.994509 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:23.994957 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:23.994958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:23.995083 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:23.995662 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:23.995672 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:23.997539 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:23.999334 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.999339 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.999341 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.999589 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:23.999805 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:23.999806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:23.999806 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:23.999899 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:24.000114 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:24.000117 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:24.000226 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.000305 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.000450 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":113,"threads_started":1}
I20260811 16:42:24.001132 32032 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35219
I20260811 16:42:24.001219 32032 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:24.001399 32032 heartbeater.cc:511] Master 127.27.186.126:35219 requested a full tablet report, sending...
I20260811 16:42:24.001853 31231 ts_manager.cc:194] Registered new tserver with Master: aab8459601b444f285b4835da122407d (127.27.186.67:45635)
I20260811 16:42:24.002352 31231 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:47923
I20260811 16:42:24.003235 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31809
I20260811 16:42:24.003332 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:24.003510 28393 external_mini_cluster.cc:1428] Setting key bd07aa2230f62a0ce3806647734ce7df
I20260811 16:42:24.004426 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:42:24.008831 32042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.002165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35219 (local address 127.27.186.67:34193)
0811 16:42:24.002286 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.002296 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.002357 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.002581 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.002582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.002739 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:24.002791 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.002792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.003703 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.003704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.004224 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.004226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.004647 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.004649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.004746 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.005252 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:24.005256 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:24.005660 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:24.007806 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:24.007807 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:24.007807 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:24.007982 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:24.008217 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:24.008217 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:24.008218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:24.008282 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:24.008575 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:24.008576 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:24.008616 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.008669 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.008752 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":70,"threads_started":1}
I20260811 16:42:24.008945 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.002236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:34193 (local address 127.27.186.126:35219)
0811 16:42:24.002279 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.002280 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.002345 (+ 65us) server_negotiation.cc:407] Connection header received
0811 16:42:24.002415 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.002416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.002426 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.002480 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:24.002886 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.003614 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.004317 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.004586 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.004648 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.005753 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:24.005755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:24.005755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:24.005762 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:24.007691 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:24.008068 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:24.008070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:24.008070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:24.008137 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:24.008355 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:24.008357 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:24.008357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:24.008507 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:24.008580 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.008720 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.008807 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 11 16:42:24 dist-test-slave-gsp7 krb5kdc[31144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:42:24 dist-test-slave-gsp7 krb5kdc[31144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:24.030786 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.023421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57930 (local address 127.27.186.126:35219)
0811 16:42:24.023490 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.023492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.023502 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:24.023548 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.023549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.023559 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.023613 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:24.024196 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.024719 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.025566 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.025749 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.025804 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.028317 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:24.028318 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:24.028318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:24.028325 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:24.029636 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:24.029999 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:24.030000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:24.030000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:24.030066 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:24.030305 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:24.030305 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:24.030305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:24.030404 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:24.030491 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.030600 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.030715 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:42:24.033025 31231 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:24.035135 31231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:24.042124 32068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.038139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42370 (local address 127.27.186.65:45535)
0811 16:42:24.038352 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.038357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.038367 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:24.038411 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.038413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.038431 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.038521 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:24.038785 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.039519 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.040793 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.041670 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.041749 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.041827 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.041972 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.042013 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":103,"threads_started":1}
I20260811 16:42:24.042109 32058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.037828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:45535 (local address 127.0.0.1:42370)
0811 16:42:24.038202 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.038209 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.038244 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.038622 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.038625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.038628 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:24.038717 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.038719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.039622 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.039623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.040685 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.040688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.041762 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.041763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.041850 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.041865 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.041943 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.042008 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":136,"threads_started":1}
I20260811 16:42:24.042371 32061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.037774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:36069 (local address 127.0.0.1:57354)
0811 16:42:24.038014 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.038033 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.038104 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.038629 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.038630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.038633 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:24.038718 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.038721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.040218 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.040219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.041144 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.041146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.042142 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.042143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.042204 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.042209 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.042244 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.042297 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":45,"thread_start_us":74,"threads_started":1}
I20260811 16:42:24.042812 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.038235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57354 (local address 127.27.186.66:36069)
0811 16:42:24.038404 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.038410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.038424 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:42:24.038473 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.038476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.038495 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.038809 (+ 314us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:24.038883 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.040113 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.041248 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.042036 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.042562 (+ 526us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.042635 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.042663 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.042703 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":89,"threads_started":1}
I20260811 16:42:24.042907 31443 tablet_service.cc:1467] Processing CreateTablet for tablet 626313d2b68b475199b7c95cf8ec0f8f (DEFAULT_TABLE table=test-table [id=b81b034dc5114685ab9e914022613a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:24.043293 32064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.037984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36084 (local address 127.27.186.67:45635)
0811 16:42:24.038486 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.038490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.038501 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:24.038542 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.038544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.038561 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.038643 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:24.038856 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.040113 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.041619 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.042796 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.042879 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.043031 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.043187 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.043218 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":111,"threads_started":1}
I20260811 16:42:24.043376 31443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 626313d2b68b475199b7c95cf8ec0f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.043316 32059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.037773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:45635 (local address 127.0.0.1:36084)
0811 16:42:24.037980 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.038032 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.038104 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.038713 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.038714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.038716 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:24.038754 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.038755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.040246 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.040247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.041536 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.041540 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.042985 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.042986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.043056 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.043060 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.043177 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.043221 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":85,"threads_started":1}
I20260811 16:42:24.044142 31915 tablet_service.cc:1467] Processing CreateTablet for tablet 626313d2b68b475199b7c95cf8ec0f8f (DEFAULT_TABLE table=test-table [id=b81b034dc5114685ab9e914022613a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:24.044400 31915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 626313d2b68b475199b7c95cf8ec0f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.047034 32071 tablet_bootstrap.cc:492] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Bootstrap starting.
I20260811 16:42:24.047115 31674 tablet_service.cc:1467] Processing CreateTablet for tablet 626313d2b68b475199b7c95cf8ec0f8f (DEFAULT_TABLE table=test-table [id=b81b034dc5114685ab9e914022613a32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:24.047328 32072 tablet_bootstrap.cc:492] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Bootstrap starting.
I20260811 16:42:24.047482 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 626313d2b68b475199b7c95cf8ec0f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.047808 32071 tablet_bootstrap.cc:654] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.048189 32071 log.cc:824] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:24.048345 32072 tablet_bootstrap.cc:654] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.048692 32072 log.cc:824] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:24.049124 32071 tablet_bootstrap.cc:492] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: No bootstrap required, opened a new log
I20260811 16:42:24.049226 32071 ts_tablet_manager.cc:1397] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:42:24.049592 32072 tablet_bootstrap.cc:492] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: No bootstrap required, opened a new log
I20260811 16:42:24.049661 32072 ts_tablet_manager.cc:1397] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:42:24.051334 32077 tablet_bootstrap.cc:492] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Bootstrap starting.
I20260811 16:42:24.051586 32071 raft_consensus.cc:348] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.051777 32071 raft_consensus.cc:374] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.051815 32071 raft_consensus.cc:729] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2dd5a320ab4e9ab593166f03176618, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.051751 32072 raft_consensus.cc:348] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.051887 32072 raft_consensus.cc:374] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.051923 32072 raft_consensus.cc:729] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab8459601b444f285b4835da122407d, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.051957 32071 consensus_queue.cc:260] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.052014 32077 tablet_bootstrap.cc:654] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.052053 32072 consensus_queue.cc:260] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.052258 32071 ts_tablet_manager.cc:1428] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:42:24.052313 32072 ts_tablet_manager.cc:1428] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:42:24.052363 32077 log.cc:824] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:24.052389 31559 heartbeater.cc:503] Master 127.27.186.126:35219 was elected leader, sending a full tablet report...
I20260811 16:42:24.052487 32032 heartbeater.cc:503] Master 127.27.186.126:35219 was elected leader, sending a full tablet report...
I20260811 16:42:24.053166 32077 tablet_bootstrap.cc:492] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: No bootstrap required, opened a new log
I20260811 16:42:24.053259 32077 ts_tablet_manager.cc:1397] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:24.055188 32077 raft_consensus.cc:348] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.055326 32077 raft_consensus.cc:374] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.055348 32077 raft_consensus.cc:729] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf421d7eb0ab44d194bcfff49a1848f8, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.055442 32077 consensus_queue.cc:260] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.055656 32077 ts_tablet_manager.cc:1428] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:42:24.055735 31797 heartbeater.cc:503] Master 127.27.186.126:35219 was elected leader, sending a full tablet report...
W20260811 16:42:24.074712 31798 tablet.cc:2369] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:42:24.132169 31560 tablet.cc:2369] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:42:24.249245 32033 tablet.cc:2369] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:24.250380 32081 raft_consensus.cc:482] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:24.250561 32081 raft_consensus.cc:504] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.250984 32081 leader_election.cc:288] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aab8459601b444f285b4835da122407d (127.27.186.67:45635), 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535)
I20260811 16:42:24.254143 32064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.251321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:38179 (local address 127.27.186.67:45635)
0811 16:42:24.251368 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.251370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.251422 (+ 52us) server_negotiation.cc:407] Connection header received
0811 16:42:24.251503 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.251504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.251516 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.251606 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:24.251784 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.252325 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.253292 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.253737 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.253850 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.253860 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.254032 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.254070 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:42:24.254177 31609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.251260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:45635 (local address 127.27.186.66:38179)
0811 16:42:24.251350 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.251365 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.251434 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.251605 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.251606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.251608 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:24.251696 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.251698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.252425 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.252426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.253187 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.253189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.253855 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.253856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.253944 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.253947 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.254025 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.254064 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:42:24.254184 32068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.251359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:42669 (local address 127.27.186.65:45535)
0811 16:42:24.251427 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.251429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.251595 (+ 166us) server_negotiation.cc:407] Connection header received
0811 16:42:24.251673 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.251674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.251682 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.251762 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:24.251926 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.252408 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.253325 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.253784 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.253880 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.253889 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.254072 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.254113 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:42:24.254213 32082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.251265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:45535 (local address 127.27.186.66:42669)
0811 16:42:24.251508 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.251516 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.251603 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.251765 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.251766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.251768 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:24.251847 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.251849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.252511 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.252512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.253223 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.253224 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.253882 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.253883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.253976 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.253980 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.254063 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.254104 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":70,"thread_start_us":99,"threads_started":1}
I20260811 16:42:24.254570 31481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "626313d2b68b475199b7c95cf8ec0f8f" candidate_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2dd5a320ab4e9ab593166f03176618" is_pre_election: true
I20260811 16:42:24.254572 31943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "626313d2b68b475199b7c95cf8ec0f8f" candidate_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab8459601b444f285b4835da122407d" is_pre_election: true
I20260811 16:42:24.254737 31943 raft_consensus.cc:2454] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf421d7eb0ab44d194bcfff49a1848f8 in term 0.
I20260811 16:42:24.254737 31481 raft_consensus.cc:2454] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf421d7eb0ab44d194bcfff49a1848f8 in term 0.
I20260811 16:42:24.254987 31598 leader_election.cc:302] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a2dd5a320ab4e9ab593166f03176618, bf421d7eb0ab44d194bcfff49a1848f8; no voters:
I20260811 16:42:24.255133 32081 raft_consensus.cc:2781] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:24.255185 32081 raft_consensus.cc:482] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:24.255223 32081 raft_consensus.cc:3037] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.256224 32081 raft_consensus.cc:504] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.256410 32081 leader_election.cc:288] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [CANDIDATE]: Term 1 election: Requested vote from peers aab8459601b444f285b4835da122407d (127.27.186.67:45635), 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535)
I20260811 16:42:24.256600 31943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "626313d2b68b475199b7c95cf8ec0f8f" candidate_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab8459601b444f285b4835da122407d"
I20260811 16:42:24.256624 31481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "626313d2b68b475199b7c95cf8ec0f8f" candidate_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2dd5a320ab4e9ab593166f03176618"
I20260811 16:42:24.256703 31481 raft_consensus.cc:3037] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.256703 31943 raft_consensus.cc:3037] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.257778 31481 raft_consensus.cc:2454] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf421d7eb0ab44d194bcfff49a1848f8 in term 1.
I20260811 16:42:24.257778 31943 raft_consensus.cc:2454] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf421d7eb0ab44d194bcfff49a1848f8 in term 1.
I20260811 16:42:24.258003 31598 leader_election.cc:302] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a2dd5a320ab4e9ab593166f03176618, bf421d7eb0ab44d194bcfff49a1848f8; no voters:
I20260811 16:42:24.258145 32081 raft_consensus.cc:2781] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:24.258292 32081 raft_consensus.cc:686] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 LEADER]: Becoming Leader. State: Replica: bf421d7eb0ab44d194bcfff49a1848f8, State: Running, Role: LEADER
I20260811 16:42:24.258405 32081 consensus_queue.cc:237] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } }
I20260811 16:42:24.259323 31231 catalog_manager.cc:5495] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66). New cstate: current_term: 1 leader_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } health_report { overall_health: UNKNOWN } } }
Aug 11 16:42:24 dist-test-slave-gsp7 krb5kdc[31144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466543, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:24.293303 32094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.286215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35219 (local address 127.0.0.1:57934)
0811 16:42:24.286375 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.286385 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.286444 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.286616 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.286617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.286924 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:24.286978 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.286980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.287646 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.287647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.288173 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.288175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.288575 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.288576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.288619 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.289167 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:24.289172 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:24.290711 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:24.292358 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:24.292364 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:24.292366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:24.292562 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:24.292743 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:24.292744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:24.292744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:24.292799 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:24.293017 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:24.293022 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:24.293064 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.293118 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.293207 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260811 16:42:24.293402 31323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.286309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57934 (local address 127.27.186.126:35219)
0811 16:42:24.286432 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.286434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.286445 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:24.286524 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.286524 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.286534 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.286587 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:24.287046 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.287567 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.288276 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.288488 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.288563 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.290796 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:24.290797 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:24.290798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:24.290804 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:24.292277 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:24.292629 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:24.292630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:24.292630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:24.292678 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:24.292855 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:24.292855 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:24.292855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:24.292957 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:24.293008 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.293151 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.293254 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":88}
I20260811 16:42:24.295652 31231 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:57934:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:42:24.295843 31231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:24.297407 31443 tablet_service.cc:1467] Processing CreateTablet for tablet a408b1ccb3164ec28711a47e7fdbcc4a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4bd85769c1874351bd93ac746a67d151]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:24.297458 31915 tablet_service.cc:1467] Processing CreateTablet for tablet a408b1ccb3164ec28711a47e7fdbcc4a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4bd85769c1874351bd93ac746a67d151]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:24.297494 31674 tablet_service.cc:1467] Processing CreateTablet for tablet a408b1ccb3164ec28711a47e7fdbcc4a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4bd85769c1874351bd93ac746a67d151]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:24.297648 31443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a408b1ccb3164ec28711a47e7fdbcc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.297664 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a408b1ccb3164ec28711a47e7fdbcc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.297663 31915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a408b1ccb3164ec28711a47e7fdbcc4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.298990 32071 tablet_bootstrap.cc:492] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: Bootstrap starting.
I20260811 16:42:24.299291 32077 tablet_bootstrap.cc:492] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: Bootstrap starting.
I20260811 16:42:24.299291 32072 tablet_bootstrap.cc:492] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: Bootstrap starting.
I20260811 16:42:24.299430 32071 tablet_bootstrap.cc:654] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.299796 32077 tablet_bootstrap.cc:654] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.299844 32072 tablet_bootstrap.cc:654] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.300594 32072 tablet_bootstrap.cc:492] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: No bootstrap required, opened a new log
I20260811 16:42:24.300601 32077 tablet_bootstrap.cc:492] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: No bootstrap required, opened a new log
I20260811 16:42:24.300649 32077 ts_tablet_manager.cc:1397] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:24.300649 32072 ts_tablet_manager.cc:1397] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:24.300683 32071 tablet_bootstrap.cc:492] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: No bootstrap required, opened a new log
I20260811 16:42:24.300729 32071 ts_tablet_manager.cc:1397] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:24.300817 32072 raft_consensus.cc:348] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.300817 32077 raft_consensus.cc:348] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.300885 32072 raft_consensus.cc:374] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.300889 32077 raft_consensus.cc:374] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.300899 32072 raft_consensus.cc:729] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab8459601b444f285b4835da122407d, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.300912 32077 raft_consensus.cc:729] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf421d7eb0ab44d194bcfff49a1848f8, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.300876 32071 raft_consensus.cc:348] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.300942 32071 raft_consensus.cc:374] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.300980 32071 raft_consensus.cc:729] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2dd5a320ab4e9ab593166f03176618, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.300963 32072 consensus_queue.cc:260] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.300959 32077 consensus_queue.cc:260] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.301028 32071 consensus_queue.cc:260] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.301059 32077 ts_tablet_manager.cc:1428] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:24.301067 32072 ts_tablet_manager.cc:1428] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:24.301127 32071 ts_tablet_manager.cc:1428] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:24.301192 32079 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.301191 32081 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.301199 32078 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.301263 32079 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:24.301278 32078 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:24.301270 32081 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:24.418831 32078 raft_consensus.cc:482] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:24.418936 32078 raft_consensus.cc:504] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.419296 32078 leader_election.cc:288] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069), aab8459601b444f285b4835da122407d (127.27.186.67:45635)
I20260811 16:42:24.422591 32098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.419487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:36069 (local address 127.27.186.65:52693)
0811 16:42:24.419642 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.419654 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.419732 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.419952 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.419953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.419955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:24.420054 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.420056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.420830 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.420831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.421646 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.421649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.422296 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.422297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.422369 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.422379 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.422422 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.422483 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":3,"thread_start_us":85,"threads_started":1}
I20260811 16:42:24.422631 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.419562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:52693 (local address 127.27.186.66:36069)
0811 16:42:24.419617 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.419619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.419740 (+ 121us) server_negotiation.cc:407] Connection header received
0811 16:42:24.419843 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.419844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.419854 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.419944 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:24.420158 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.420731 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.421821 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.422183 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.422240 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.422274 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.422477 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.422531 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:42:24.422960 31711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a408b1ccb3164ec28711a47e7fdbcc4a" candidate_uuid: "7a2dd5a320ab4e9ab593166f03176618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" is_pre_election: true
I20260811 16:42:24.423135 31711 raft_consensus.cc:2454] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a2dd5a320ab4e9ab593166f03176618 in term 0.
I20260811 16:42:24.423205 32099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.419557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:45635 (local address 127.27.186.65:60227)
0811 16:42:24.419664 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.419675 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.419776 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.419947 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.419948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.419950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:24.420048 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.420050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.420739 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.420740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.421705 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.421707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.422306 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.422307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.422978 (+ 671us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.422984 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.423074 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.423111 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":33,"thread_start_us":65,"threads_started":1}
I20260811 16:42:24.423195 32064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.419626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:60227 (local address 127.27.186.67:45635)
0811 16:42:24.419675 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.419677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.419787 (+ 110us) server_negotiation.cc:407] Connection header received
0811 16:42:24.419845 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.419846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.419863 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.419941 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:24.420130 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.420648 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.421830 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.422186 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.422289 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.422298 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.423082 (+ 784us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.423124 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:42:24.423393 31378 leader_election.cc:302] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a2dd5a320ab4e9ab593166f03176618, bf421d7eb0ab44d194bcfff49a1848f8; no voters:
I20260811 16:42:24.423554 32078 raft_consensus.cc:2781] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:24.423595 32078 raft_consensus.cc:482] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:24.423629 32078 raft_consensus.cc:3037] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.423663 31943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a408b1ccb3164ec28711a47e7fdbcc4a" candidate_uuid: "7a2dd5a320ab4e9ab593166f03176618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab8459601b444f285b4835da122407d" is_pre_election: true
I20260811 16:42:24.423765 31943 raft_consensus.cc:2454] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a2dd5a320ab4e9ab593166f03176618 in term 0.
I20260811 16:42:24.424454 32078 raft_consensus.cc:504] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.424614 32078 leader_election.cc:288] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [CANDIDATE]: Term 1 election: Requested vote from peers bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069), aab8459601b444f285b4835da122407d (127.27.186.67:45635)
I20260811 16:42:24.424757 31711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a408b1ccb3164ec28711a47e7fdbcc4a" candidate_uuid: "7a2dd5a320ab4e9ab593166f03176618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf421d7eb0ab44d194bcfff49a1848f8"
I20260811 16:42:24.424849 31711 raft_consensus.cc:3037] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.424870 31943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a408b1ccb3164ec28711a47e7fdbcc4a" candidate_uuid: "7a2dd5a320ab4e9ab593166f03176618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab8459601b444f285b4835da122407d"
I20260811 16:42:24.424947 31943 raft_consensus.cc:3037] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.425844 31711 raft_consensus.cc:2454] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a2dd5a320ab4e9ab593166f03176618 in term 1.
I20260811 16:42:24.425844 31943 raft_consensus.cc:2454] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a2dd5a320ab4e9ab593166f03176618 in term 1.
I20260811 16:42:24.426043 31376 leader_election.cc:302] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a2dd5a320ab4e9ab593166f03176618, aab8459601b444f285b4835da122407d; no voters:
I20260811 16:42:24.426149 32078 raft_consensus.cc:2781] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:24.426275 32078 raft_consensus.cc:686] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [term 1 LEADER]: Becoming Leader. State: Replica: 7a2dd5a320ab4e9ab593166f03176618, State: Running, Role: LEADER
I20260811 16:42:24.426383 32078 consensus_queue.cc:237] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.426834 32101 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: TxnStatusTablet state changed. Reason: New leader 7a2dd5a320ab4e9ab593166f03176618. Latest consensus state: current_term: 1 leader_uuid: "7a2dd5a320ab4e9ab593166f03176618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.426928 32101 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:24.427145 32105 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:42:24.427280 32105 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:42:24.427287 31229 catalog_manager.cc:5495] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65). New cstate: current_term: 1 leader_uuid: "7a2dd5a320ab4e9ab593166f03176618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } health_report { overall_health: UNKNOWN } } }
I20260811 16:42:24.450047 32094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.447334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:45535 (local address 127.0.0.1:42376)
0811 16:42:24.447413 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.447428 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.447507 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.447700 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.447701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.447702 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:24.447756 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.447758 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.448457 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.448459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.449057 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.449059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.449442 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.449443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.449547 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.449568 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:24.449855 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:24.449867 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.449903 (+ 36us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.449954 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 16:42:24.450043 32068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.447422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42376 (local address 127.27.186.65:45535)
0811 16:42:24.447493 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.447495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.447506 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:24.447591 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.447592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.447611 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.447693 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:24.447840 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.448362 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.449156 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.449359 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.449443 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.449673 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:24.449780 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:24.449890 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.449917 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.449938 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:42:24.452181 31711 raft_consensus.cc:1261] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Refusing update from remote peer 7a2dd5a320ab4e9ab593166f03176618: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:24.452183 31943 raft_consensus.cc:1261] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Refusing update from remote peer 7a2dd5a320ab4e9ab593166f03176618: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:24.452544 32101 consensus_queue.cc:1035] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:24.452694 32078 consensus_queue.cc:1035] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:24.453935 32081 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: TxnStatusTablet state changed. Reason: New leader 7a2dd5a320ab4e9ab593166f03176618. Latest consensus state: current_term: 1 leader_uuid: "7a2dd5a320ab4e9ab593166f03176618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.454043 32081 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:24.454012 32079 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: TxnStatusTablet state changed. Reason: New leader 7a2dd5a320ab4e9ab593166f03176618. Latest consensus state: current_term: 1 leader_uuid: "7a2dd5a320ab4e9ab593166f03176618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.454130 32079 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:24.455190 32078 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7a2dd5a320ab4e9ab593166f03176618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.455287 32078 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:24.455232 32079 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7a2dd5a320ab4e9ab593166f03176618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.455330 32079 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P aab8459601b444f285b4835da122407d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:24.455411 32078 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7a2dd5a320ab4e9ab593166f03176618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.455480 32078 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P 7a2dd5a320ab4e9ab593166f03176618: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:24.455567 32108 mvcc.cc:205] Tried to move back new op lower bound from 7317366966072827904 to 7317366965970898944. Current Snapshot: MvccSnapshot[applied={T|T < 7317366966072827904}]
I20260811 16:42:24.455878 32111 mvcc.cc:205] Tried to move back new op lower bound from 7317366966072827904 to 7317366965970898944. Current Snapshot: MvccSnapshot[applied={T|T < 7317366966072827904}]
I20260811 16:42:24.455932 32081 tablet_replica.cc:439] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7a2dd5a320ab4e9ab593166f03176618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } } }
I20260811 16:42:24.456007 32081 tablet_replica.cc:442] T a408b1ccb3164ec28711a47e7fdbcc4a P bf421d7eb0ab44d194bcfff49a1848f8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:24.456707 32110 mvcc.cc:205] Tried to move back new op lower bound from 7317366966072827904 to 7317366965970898944. Current Snapshot: MvccSnapshot[applied={T|T < 7317366966072827904}]
I20260811 16:42:24.461390 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.458650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57368 (local address 127.27.186.66:36069)
0811 16:42:24.458691 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.458693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.458703 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:24.458758 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.458759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.458777 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.458861 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:24.459026 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.459769 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.460523 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.460841 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.460913 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.461061 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:24.461189 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:24.461272 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.461296 (+ 24us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.461317 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:42:24.466745 32068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.464109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:60265 (local address 127.27.186.65:45535)
0811 16:42:24.464175 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.464177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.464282 (+ 105us) server_negotiation.cc:407] Connection header received
0811 16:42:24.464351 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.464352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.464362 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.464412 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:24.464573 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.465033 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.465983 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.466175 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.466254 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.466459 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:24.466492 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:24.466580 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.466651 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.466670 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:42:24.466768 32123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.464021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:45535 (local address 127.27.186.66:60265)
0811 16:42:24.464202 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.464216 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.464298 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.464433 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.464435 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.464436 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:24.464500 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.464502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.465122 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.465123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.465884 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.465888 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.466254 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.466255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.466329 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.466342 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:24.466585 (+ 243us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:24.466588 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.466644 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.466688 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":92,"threads_started":1}
I20260811 16:42:24.469565 31943 raft_consensus.cc:1261] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Refusing update from remote peer bf421d7eb0ab44d194bcfff49a1848f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:24.469592 31481 raft_consensus.cc:1261] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Refusing update from remote peer bf421d7eb0ab44d194bcfff49a1848f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:24.469894 32083 consensus_queue.cc:1035] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:24.470148 32081 consensus_queue.cc:1035] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:24.480284 32070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.477445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:38893 (local address 127.27.186.66:36069)
0811 16:42:24.477509 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:24.477511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:24.477581 (+ 70us) server_negotiation.cc:407] Connection header received
0811 16:42:24.477664 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:24.477665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:24.477673 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:24.477719 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:24.477891 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.478385 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.479542 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.479808 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.479863 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.480089 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:24.480116 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:24.480149 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:24.480213 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 16:42:24.480229 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:42:24.480370 32135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:24.477281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:36069 (local address 127.27.186.65:38893)
0811 16:42:24.477521 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:24.477535 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:24.477598 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:24.477723 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:24.477724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:24.477725 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:24.477825 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.477827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.478485 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.478486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.479451 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:24.479455 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:24.479910 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:24.479911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:24.479979 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:24.479998 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:24.480154 (+ 156us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:24.480155 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:42:24.480213 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:42:24.480268 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":110,"threads_started":1}
I20260811 16:42:24.489379 31229 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:24.489552 31229 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:24.490376 31229 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: Sending DeleteTablet for 3 replicas of tablet 626313d2b68b475199b7c95cf8ec0f8f
I20260811 16:42:24.490839 31915 tablet_service.cc:1514] Processing DeleteTablet for tablet 626313d2b68b475199b7c95cf8ec0f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:24 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:36084
I20260811 16:42:24.491115 32141 tablet_replica.cc:330] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: stopping tablet replica
I20260811 16:42:24.491137 31674 tablet_service.cc:1514] Processing DeleteTablet for tablet 626313d2b68b475199b7c95cf8ec0f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:24 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:57354
I20260811 16:42:24.491364 32141 raft_consensus.cc:2229] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:24.491338 31229 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:24.491497 31229 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:24.491663 32141 raft_consensus.cc:2258] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:24.492264 32141 ts_tablet_manager.cc:1905] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:24.493112 31915 tablet_service.cc:1467] Processing CreateTablet for tablet 76f6ecea4d92468eb334b8b6e92ac8b6 (DEFAULT_TABLE table=test-table [id=37113b4e8efe42a2ba9ef536170572c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:24.493237 31915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76f6ecea4d92468eb334b8b6e92ac8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.493629 31674 tablet_service.cc:1467] Processing CreateTablet for tablet 76f6ecea4d92468eb334b8b6e92ac8b6 (DEFAULT_TABLE table=test-table [id=37113b4e8efe42a2ba9ef536170572c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:24.493752 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76f6ecea4d92468eb334b8b6e92ac8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.494516 32141 ts_tablet_manager.cc:1918] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:24.494643 32141 log.cc:1196] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/626313d2b68b475199b7c95cf8ec0f8f
I20260811 16:42:24.494992 32141 ts_tablet_manager.cc:1939] T 626313d2b68b475199b7c95cf8ec0f8f P aab8459601b444f285b4835da122407d: Deleting consensus metadata
I20260811 16:42:24.495357 32077 tablet_bootstrap.cc:492] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: Bootstrap starting.
I20260811 16:42:24.495595 31211 catalog_manager.cc:4841] TS aab8459601b444f285b4835da122407d (127.27.186.67:45635): tablet 626313d2b68b475199b7c95cf8ec0f8f (table test-table [id=b81b034dc5114685ab9e914022613a32]) successfully deleted
I20260811 16:42:24.495877 32077 tablet_bootstrap.cc:654] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.496591 32072 tablet_bootstrap.cc:492] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: Bootstrap starting.
I20260811 16:42:24.496644 32077 tablet_bootstrap.cc:492] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: No bootstrap required, opened a new log
I20260811 16:42:24.496680 32077 ts_tablet_manager.cc:1397] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:24.496862 32077 raft_consensus.cc:348] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.496938 32077 raft_consensus.cc:374] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.496964 32077 raft_consensus.cc:729] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf421d7eb0ab44d194bcfff49a1848f8, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.497004 32072 tablet_bootstrap.cc:654] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.497016 32077 consensus_queue.cc:260] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.497121 32077 ts_tablet_manager.cc:1428] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:24.497846 31443 tablet_service.cc:1514] Processing DeleteTablet for tablet 626313d2b68b475199b7c95cf8ec0f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:24 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:42370
I20260811 16:42:24.497892 31442 tablet_service.cc:1467] Processing CreateTablet for tablet 76f6ecea4d92468eb334b8b6e92ac8b6 (DEFAULT_TABLE table=test-table [id=37113b4e8efe42a2ba9ef536170572c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:24.498181 31442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76f6ecea4d92468eb334b8b6e92ac8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:24.498221 32072 tablet_bootstrap.cc:492] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: No bootstrap required, opened a new log
I20260811 16:42:24.498260 32072 ts_tablet_manager.cc:1397] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:24.498282 32142 tablet_replica.cc:330] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: stopping tablet replica
I20260811 16:42:24.498392 32142 raft_consensus.cc:2229] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:24.498402 32072 raft_consensus.cc:348] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.498474 32072 raft_consensus.cc:374] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.498494 32072 raft_consensus.cc:729] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab8459601b444f285b4835da122407d, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.498497 32142 raft_consensus.cc:2258] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:24.498533 32072 consensus_queue.cc:260] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.498607 32072 ts_tablet_manager.cc:1428] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:24.498979 32142 ts_tablet_manager.cc:1905] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:24.500012 32071 tablet_bootstrap.cc:492] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: Bootstrap starting.
I20260811 16:42:24.498188 32152 tablet_replica.cc:330] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: stopping tablet replica
I20260811 16:42:24.500384 32152 raft_consensus.cc:2229] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:24.500416 32071 tablet_bootstrap.cc:654] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:24.500913 32152 raft_consensus.cc:2258] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:24.501400 32071 tablet_bootstrap.cc:492] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: No bootstrap required, opened a new log
I20260811 16:42:24.501451 32071 ts_tablet_manager.cc:1397] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:24.501626 32142 ts_tablet_manager.cc:1918] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:24.501677 32071 raft_consensus.cc:348] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.501736 32142 log.cc:1196] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/626313d2b68b475199b7c95cf8ec0f8f
I20260811 16:42:24.501762 32071 raft_consensus.cc:374] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:24.501796 32071 raft_consensus.cc:729] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2dd5a320ab4e9ab593166f03176618, State: Initialized, Role: FOLLOWER
I20260811 16:42:24.501842 32071 consensus_queue.cc:260] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.501937 32071 ts_tablet_manager.cc:1428] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:24.501433 32152 ts_tablet_manager.cc:1905] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:24.502027 32142 ts_tablet_manager.cc:1939] T 626313d2b68b475199b7c95cf8ec0f8f P bf421d7eb0ab44d194bcfff49a1848f8: Deleting consensus metadata
I20260811 16:42:24.502450 31215 catalog_manager.cc:4841] TS bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069): tablet 626313d2b68b475199b7c95cf8ec0f8f (table test-table [id=b81b034dc5114685ab9e914022613a32]) successfully deleted
I20260811 16:42:24.503779 32152 ts_tablet_manager.cc:1918] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:24.503859 32152 log.cc:1196] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/626313d2b68b475199b7c95cf8ec0f8f
I20260811 16:42:24.504153 32152 ts_tablet_manager.cc:1939] T 626313d2b68b475199b7c95cf8ec0f8f P 7a2dd5a320ab4e9ab593166f03176618: Deleting consensus metadata
I20260811 16:42:24.504631 31209 catalog_manager.cc:4841] TS 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535): tablet 626313d2b68b475199b7c95cf8ec0f8f (table test-table [id=b81b034dc5114685ab9e914022613a32]) successfully deleted
I20260811 16:42:24.691511 32129 raft_consensus.cc:482] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:24.691684 32129 raft_consensus.cc:504] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.691932 32129 leader_election.cc:288] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535), aab8459601b444f285b4835da122407d (127.27.186.67:45635)
I20260811 16:42:24.692205 31481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76f6ecea4d92468eb334b8b6e92ac8b6" candidate_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2dd5a320ab4e9ab593166f03176618" is_pre_election: true
I20260811 16:42:24.692248 31943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76f6ecea4d92468eb334b8b6e92ac8b6" candidate_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab8459601b444f285b4835da122407d" is_pre_election: true
I20260811 16:42:24.692339 31481 raft_consensus.cc:2454] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf421d7eb0ab44d194bcfff49a1848f8 in term 0.
I20260811 16:42:24.692401 31943 raft_consensus.cc:2454] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf421d7eb0ab44d194bcfff49a1848f8 in term 0.
I20260811 16:42:24.692546 31598 leader_election.cc:302] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a2dd5a320ab4e9ab593166f03176618, bf421d7eb0ab44d194bcfff49a1848f8; no voters:
I20260811 16:42:24.692660 32129 raft_consensus.cc:2781] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:24.692711 32129 raft_consensus.cc:482] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:24.692739 32129 raft_consensus.cc:3037] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.693634 32129 raft_consensus.cc:504] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.693805 32129 leader_election.cc:288] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [CANDIDATE]: Term 1 election: Requested vote from peers 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535), aab8459601b444f285b4835da122407d (127.27.186.67:45635)
I20260811 16:42:24.694003 31943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76f6ecea4d92468eb334b8b6e92ac8b6" candidate_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab8459601b444f285b4835da122407d"
I20260811 16:42:24.694005 31481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76f6ecea4d92468eb334b8b6e92ac8b6" candidate_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2dd5a320ab4e9ab593166f03176618"
I20260811 16:42:24.694092 31943 raft_consensus.cc:3037] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.694092 31481 raft_consensus.cc:3037] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:24.694960 31943 raft_consensus.cc:2454] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf421d7eb0ab44d194bcfff49a1848f8 in term 1.
I20260811 16:42:24.694973 31481 raft_consensus.cc:2454] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf421d7eb0ab44d194bcfff49a1848f8 in term 1.
I20260811 16:42:24.695161 31599 leader_election.cc:302] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aab8459601b444f285b4835da122407d, bf421d7eb0ab44d194bcfff49a1848f8; no voters:
I20260811 16:42:24.695304 32129 raft_consensus.cc:2781] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:24.695367 32129 raft_consensus.cc:686] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 LEADER]: Becoming Leader. State: Replica: bf421d7eb0ab44d194bcfff49a1848f8, State: Running, Role: LEADER
I20260811 16:42:24.695406 32129 consensus_queue.cc:237] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:24.696130 31230 catalog_manager.cc:5495] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66). New cstate: current_term: 1 leader_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } health_report { overall_health: UNKNOWN } } }
I20260811 16:42:24.732393 31943 raft_consensus.cc:1261] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Refusing update from remote peer bf421d7eb0ab44d194bcfff49a1848f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:24.732396 31481 raft_consensus.cc:1261] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Refusing update from remote peer bf421d7eb0ab44d194bcfff49a1848f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:24.732685 32083 consensus_queue.cc:1035] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:24.732815 32129 consensus_queue.cc:1035] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:42:24.737700 32110 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 16:42:26.256524 31229 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:26.256640 31229 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:26.257552 31229 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: Sending DeleteTablet for 3 replicas of tablet 76f6ecea4d92468eb334b8b6e92ac8b6
I20260811 16:42:26.257850 31674 tablet_service.cc:1514] Processing DeleteTablet for tablet 76f6ecea4d92468eb334b8b6e92ac8b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:26 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:57354
I20260811 16:42:26.257860 31442 tablet_service.cc:1514] Processing DeleteTablet for tablet 76f6ecea4d92468eb334b8b6e92ac8b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:26 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:42370
I20260811 16:42:26.258087 32191 tablet_replica.cc:330] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: stopping tablet replica
I20260811 16:42:26.258100 31915 tablet_service.cc:1514] Processing DeleteTablet for tablet 76f6ecea4d92468eb334b8b6e92ac8b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:26 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:36084
I20260811 16:42:26.258173 32191 raft_consensus.cc:2229] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:26.258220 32191 raft_consensus.cc:2258] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:26.258476 32191 ts_tablet_manager.cc:1905] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:26.260246 32191 ts_tablet_manager.cc:1918] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:42:26.260345 32191 log.cc:1196] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/76f6ecea4d92468eb334b8b6e92ac8b6
I20260811 16:42:26.260612 32191 ts_tablet_manager.cc:1939] T 76f6ecea4d92468eb334b8b6e92ac8b6 P 7a2dd5a320ab4e9ab593166f03176618: Deleting consensus metadata
I20260811 16:42:26.261020 31209 catalog_manager.cc:4841] TS 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535): tablet 76f6ecea4d92468eb334b8b6e92ac8b6 (table test-table [id=37113b4e8efe42a2ba9ef536170572c6]) successfully deleted
I20260811 16:42:26.261600 32190 tablet_replica.cc:330] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: stopping tablet replica
I20260811 16:42:26.261620 32192 tablet_replica.cc:330] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: stopping tablet replica
I20260811 16:42:26.261677 32190 raft_consensus.cc:2229] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:26.261694 32192 raft_consensus.cc:2229] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:26.261739 32192 raft_consensus.cc:2258] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:26.261761 32190 raft_consensus.cc:2258] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:26.262001 32192 ts_tablet_manager.cc:1905] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:26.262033 32190 ts_tablet_manager.cc:1905] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:26.263490 32192 ts_tablet_manager.cc:1918] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:42:26.263554 32192 log.cc:1196] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/76f6ecea4d92468eb334b8b6e92ac8b6
I20260811 16:42:26.263818 32192 ts_tablet_manager.cc:1939] T 76f6ecea4d92468eb334b8b6e92ac8b6 P aab8459601b444f285b4835da122407d: Deleting consensus metadata
I20260811 16:42:26.263983 32190 ts_tablet_manager.cc:1918] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:42:26.264052 32190 log.cc:1196] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/76f6ecea4d92468eb334b8b6e92ac8b6
I20260811 16:42:26.264187 31211 catalog_manager.cc:4841] TS aab8459601b444f285b4835da122407d (127.27.186.67:45635): tablet 76f6ecea4d92468eb334b8b6e92ac8b6 (table test-table [id=37113b4e8efe42a2ba9ef536170572c6]) successfully deleted
I20260811 16:42:26.264315 32190 ts_tablet_manager.cc:1939] T 76f6ecea4d92468eb334b8b6e92ac8b6 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting consensus metadata
I20260811 16:42:26.264691 31215 catalog_manager.cc:4841] TS bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069): tablet 76f6ecea4d92468eb334b8b6e92ac8b6 (table test-table [id=37113b4e8efe42a2ba9ef536170572c6]) successfully deleted
Aug 11 16:42:26 dist-test-slave-gsp7 krb5kdc[31144](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466546, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:42:26 dist-test-slave-gsp7 krb5kdc[31144](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466546, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:26.290490 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.277181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48474 (local address 127.27.186.126:35219)
0811 16:42:26.277373 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:26.277375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:26.277436 (+ 61us) server_negotiation.cc:407] Connection header received
0811 16:42:26.277558 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:26.277559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:26.277576 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:26.277652 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:26.278252 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.278888 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.279734 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.280030 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.280116 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.287575 (+ 7459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:26.287577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:26.287577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:26.287586 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:26.289142 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:26.289577 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:26.289578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:26.289578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:26.289660 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:26.289888 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:26.289889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:26.289890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:26.290047 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:26.290170 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:26.290279 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 16:42:26.290371 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":130,"threads_started":1}
I20260811 16:42:26.292043 31229 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48474:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:26.292244 31229 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:26.293745 31442 tablet_service.cc:1467] Processing CreateTablet for tablet fd2e82f2715b4684a76e957996658665 (DEFAULT_TABLE table=test-table [id=d8318c8df3164d82acdd7714415ab165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:26.293756 31915 tablet_service.cc:1467] Processing CreateTablet for tablet fd2e82f2715b4684a76e957996658665 (DEFAULT_TABLE table=test-table [id=d8318c8df3164d82acdd7714415ab165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:26.293751 31674 tablet_service.cc:1467] Processing CreateTablet for tablet fd2e82f2715b4684a76e957996658665 (DEFAULT_TABLE table=test-table [id=d8318c8df3164d82acdd7714415ab165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:26.293919 31915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2e82f2715b4684a76e957996658665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:26.293919 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2e82f2715b4684a76e957996658665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:26.293923 31442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2e82f2715b4684a76e957996658665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:26.295367 32209 tablet_bootstrap.cc:492] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: Bootstrap starting.
I20260811 16:42:26.295504 32210 tablet_bootstrap.cc:492] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: Bootstrap starting.
I20260811 16:42:26.295528 32207 tablet_bootstrap.cc:492] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: Bootstrap starting.
I20260811 16:42:26.295873 32207 tablet_bootstrap.cc:654] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:26.295955 32210 tablet_bootstrap.cc:654] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:26.296660 32209 tablet_bootstrap.cc:654] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:26.296715 32210 tablet_bootstrap.cc:492] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: No bootstrap required, opened a new log
I20260811 16:42:26.296779 32210 ts_tablet_manager.cc:1397] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:26.296927 32210 raft_consensus.cc:348] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.297040 32210 raft_consensus.cc:374] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:26.297070 32210 raft_consensus.cc:729] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2dd5a320ab4e9ab593166f03176618, State: Initialized, Role: FOLLOWER
I20260811 16:42:26.297122 32210 consensus_queue.cc:260] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.297235 32210 ts_tablet_manager.cc:1428] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:26.297462 32207 tablet_bootstrap.cc:492] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: No bootstrap required, opened a new log
I20260811 16:42:26.297519 32209 tablet_bootstrap.cc:492] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: No bootstrap required, opened a new log
I20260811 16:42:26.297560 32207 ts_tablet_manager.cc:1397] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:26.297564 32209 ts_tablet_manager.cc:1397] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:26.297685 32207 raft_consensus.cc:348] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.297762 32207 raft_consensus.cc:374] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:26.297719 32209 raft_consensus.cc:348] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.297792 32207 raft_consensus.cc:729] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf421d7eb0ab44d194bcfff49a1848f8, State: Initialized, Role: FOLLOWER
I20260811 16:42:26.297801 32209 raft_consensus.cc:374] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:26.297837 32209 raft_consensus.cc:729] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab8459601b444f285b4835da122407d, State: Initialized, Role: FOLLOWER
I20260811 16:42:26.297840 32207 consensus_queue.cc:260] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.297883 32209 consensus_queue.cc:260] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.297925 32207 ts_tablet_manager.cc:1428] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:26.298059 32209 ts_tablet_manager.cc:1428] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:26.414090 32218 raft_consensus.cc:482] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:26.414197 32218 raft_consensus.cc:504] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.414736 32218 leader_election.cc:288] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535), bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069)
I20260811 16:42:26.418084 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.414979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:52681 (local address 127.27.186.65:45535)
0811 16:42:26.415181 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:26.415183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:26.415266 (+ 83us) server_negotiation.cc:407] Connection header received
0811 16:42:26.415381 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:26.415382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:26.415398 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:26.415478 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:26.415648 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.416146 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.417218 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.417689 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.417785 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.417795 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:26.417964 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 16:42:26.418007 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":99,"threads_started":1}
I20260811 16:42:26.418097 32224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.415048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:37301 (local address 127.27.186.66:36069)
0811 16:42:26.415202 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:26.415204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:26.415304 (+ 100us) server_negotiation.cc:407] Connection header received
0811 16:42:26.415407 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:26.415408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:26.415417 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:26.415508 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:26.415657 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.416158 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.417223 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.417689 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.417793 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.417803 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:26.417970 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 16:42:26.418019 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260811 16:42:26.418102 32219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.414919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:45535 (local address 127.27.186.67:52681)
0811 16:42:26.415180 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:26.415192 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:26.415285 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:26.415482 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:26.415483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:26.415485 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:26.415569 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:26.415571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.416243 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.416244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:26.417112 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:26.417114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.417783 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.417784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:26.417871 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.417875 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:26.417944 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:42:26.417990 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":36,"thread_start_us":162,"threads_started":1}
I20260811 16:42:26.418118 32222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.414927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:36069 (local address 127.27.186.67:37301)
0811 16:42:26.415208 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:26.415219 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:26.415317 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:26.415509 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:26.415510 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:26.415512 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:26.415572 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:26.415574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.416253 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.416254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:26.417111 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:26.417113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.417815 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.417816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:26.417886 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.417890 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:26.417964 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 16:42:26.418008 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":24,"thread_start_us":149,"threads_started":1}
I20260811 16:42:26.418399 31481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2e82f2715b4684a76e957996658665" candidate_uuid: "aab8459601b444f285b4835da122407d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2dd5a320ab4e9ab593166f03176618" is_pre_election: true
I20260811 16:42:26.418505 31481 raft_consensus.cc:2454] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aab8459601b444f285b4835da122407d in term 0.
I20260811 16:42:26.418637 31711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2e82f2715b4684a76e957996658665" candidate_uuid: "aab8459601b444f285b4835da122407d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" is_pre_election: true
I20260811 16:42:26.418723 31711 raft_consensus.cc:2454] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aab8459601b444f285b4835da122407d in term 0.
I20260811 16:42:26.418728 31842 leader_election.cc:302] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a2dd5a320ab4e9ab593166f03176618, aab8459601b444f285b4835da122407d; no voters:
I20260811 16:42:26.418974 32218 raft_consensus.cc:2781] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:26.419037 32218 raft_consensus.cc:482] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:26.419063 32218 raft_consensus.cc:3037] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:26.419809 32218 raft_consensus.cc:504] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.419979 32218 leader_election.cc:288] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [CANDIDATE]: Term 1 election: Requested vote from peers 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535), bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069)
I20260811 16:42:26.420113 31481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2e82f2715b4684a76e957996658665" candidate_uuid: "aab8459601b444f285b4835da122407d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2dd5a320ab4e9ab593166f03176618"
I20260811 16:42:26.420197 31481 raft_consensus.cc:3037] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:26.420219 31711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2e82f2715b4684a76e957996658665" candidate_uuid: "aab8459601b444f285b4835da122407d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf421d7eb0ab44d194bcfff49a1848f8"
I20260811 16:42:26.420305 31711 raft_consensus.cc:3037] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:26.420993 31481 raft_consensus.cc:2454] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aab8459601b444f285b4835da122407d in term 1.
I20260811 16:42:26.421072 31711 raft_consensus.cc:2454] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aab8459601b444f285b4835da122407d in term 1.
I20260811 16:42:26.421201 31842 leader_election.cc:302] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a2dd5a320ab4e9ab593166f03176618, aab8459601b444f285b4835da122407d; no voters:
I20260811 16:42:26.421344 32218 raft_consensus.cc:2781] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:26.421515 32218 raft_consensus.cc:686] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 1 LEADER]: Becoming Leader. State: Replica: aab8459601b444f285b4835da122407d, State: Running, Role: LEADER
I20260811 16:42:26.421643 32218 consensus_queue.cc:237] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.422392 31229 catalog_manager.cc:5495] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d reported cstate change: term changed from 0 to 1, leader changed from <none> to aab8459601b444f285b4835da122407d (127.27.186.67). New cstate: current_term: 1 leader_uuid: "aab8459601b444f285b4835da122407d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } health_report { overall_health: HEALTHY } } }
I20260811 16:42:26.447070 32229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.444571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44596 (local address 127.27.186.67:45635)
0811 16:42:26.444713 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:26.444714 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:26.444720 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:42:26.444757 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:26.444757 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:26.444778 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:26.444851 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:26.445006 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.445512 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.446283 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.446494 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.446549 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.446697 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:26.446804 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:26.446863 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:26.446917 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 16:42:26.446933 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260811 16:42:26.452024 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.449788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:39673 (local address 127.27.186.65:45535)
0811 16:42:26.449863 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:26.449865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:26.449916 (+ 51us) server_negotiation.cc:407] Connection header received
0811 16:42:26.449962 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:26.449963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:26.449971 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:26.450039 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:26.450182 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.450666 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.451410 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.451590 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.451640 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.451824 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:26.451849 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:26.451889 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:26.451952 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 16:42:26.451970 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:42:26.452049 32232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.449678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:45535 (local address 127.27.186.67:39673)
0811 16:42:26.449848 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:26.449859 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:26.449919 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:26.450053 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:26.450053 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:26.450055 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:26.450105 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:26.450107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.450738 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.450738 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:26.451311 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:26.451313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.451666 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.451667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:26.451734 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.451749 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:26.451913 (+ 164us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:26.451914 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:42:26.451949 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 16:42:26.451985 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260811 16:42:26.454335 31481 raft_consensus.cc:1261] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Refusing update from remote peer aab8459601b444f285b4835da122407d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:26.454373 31711 raft_consensus.cc:1261] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Refusing update from remote peer aab8459601b444f285b4835da122407d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:26.454650 32225 consensus_queue.cc:1035] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:26.454798 32218 consensus_queue.cc:1035] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:26.462379 32229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.459906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:35673 (local address 127.27.186.67:45635)
0811 16:42:26.459954 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:26.459956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:26.460091 (+ 135us) server_negotiation.cc:407] Connection header received
0811 16:42:26.460127 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:26.460128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:26.460137 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:26.460171 (+ 34us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:26.460274 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.460742 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.461583 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.461875 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.461961 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.462135 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:26.462176 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:26.462228 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:26.462283 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:42:26.462305 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:42:26.462410 32243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:26.459864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:45635 (local address 127.27.186.65:35673)
0811 16:42:26.460006 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:26.460018 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:26.460081 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:26.460193 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:26.460194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:26.460195 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:26.460239 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:26.460241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.460814 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.460815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:26.461384 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:26.461387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:26.461975 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:26.461977 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:26.462044 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:26.462049 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:26.462229 (+ 180us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:26.462232 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:26.462279 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:42:26.462324 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":92,"threads_started":1}
I20260811 16:42:26.469163 31229 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:26.469318 31229 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:26.470101 31229 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: Sending DeleteTablet for 3 replicas of tablet fd2e82f2715b4684a76e957996658665
I20260811 16:42:26.470382 31442 tablet_service.cc:1514] Processing DeleteTablet for tablet fd2e82f2715b4684a76e957996658665 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:26 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:42370
I20260811 16:42:26.470419 31915 tablet_service.cc:1514] Processing DeleteTablet for tablet fd2e82f2715b4684a76e957996658665 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:26 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:36084
I20260811 16:42:26.470511 32192 tablet_replica.cc:330] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: stopping tablet replica
I20260811 16:42:26.470511 32191 tablet_replica.cc:330] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: stopping tablet replica
I20260811 16:42:26.470564 32192 raft_consensus.cc:2229] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:26.470569 32191 raft_consensus.cc:2229] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:26.470556 31674 tablet_service.cc:1514] Processing DeleteTablet for tablet fd2e82f2715b4684a76e957996658665 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:26 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:57354
I20260811 16:42:26.470616 32191 raft_consensus.cc:2258] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:26.470650 32190 tablet_replica.cc:330] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: stopping tablet replica
I20260811 16:42:26.470654 32192 raft_consensus.cc:2258] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:26.470697 32190 raft_consensus.cc:2229] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:26.470732 32190 raft_consensus.cc:2258] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:26.470968 32191 ts_tablet_manager.cc:1905] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:26.470966 32192 ts_tablet_manager.cc:1905] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:26.471104 32190 ts_tablet_manager.cc:1905] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:26.471115 31229 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48474:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:26.471261 31229 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:26.472431 31915 tablet_service.cc:1467] Processing CreateTablet for tablet 4c27653104ef408eb00a9a044200dbc5 (DEFAULT_TABLE table=test-table [id=8d9d206534d549a89bfe76df7514a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:26.472779 31674 tablet_service.cc:1467] Processing CreateTablet for tablet 4c27653104ef408eb00a9a044200dbc5 (DEFAULT_TABLE table=test-table [id=8d9d206534d549a89bfe76df7514a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:26.472905 32190 ts_tablet_manager.cc:1918] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:26.472947 31674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c27653104ef408eb00a9a044200dbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:26.472935 31442 tablet_service.cc:1467] Processing CreateTablet for tablet 4c27653104ef408eb00a9a044200dbc5 (DEFAULT_TABLE table=test-table [id=8d9d206534d549a89bfe76df7514a62a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:26.472950 32190 log.cc:1196] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/fd2e82f2715b4684a76e957996658665
I20260811 16:42:26.473205 32190 ts_tablet_manager.cc:1939] T fd2e82f2715b4684a76e957996658665 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting consensus metadata
I20260811 16:42:26.473578 31215 catalog_manager.cc:4841] TS bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069): tablet fd2e82f2715b4684a76e957996658665 (table test-table [id=d8318c8df3164d82acdd7714415ab165]) successfully deleted
I20260811 16:42:26.474165 32207 tablet_bootstrap.cc:492] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: Bootstrap starting.
I20260811 16:42:26.474439 31442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c27653104ef408eb00a9a044200dbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:26.474570 32192 ts_tablet_manager.cc:1918] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:26.474602 32207 tablet_bootstrap.cc:654] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:26.474623 32192 log.cc:1196] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/fd2e82f2715b4684a76e957996658665
I20260811 16:42:26.474838 32192 ts_tablet_manager.cc:1939] T fd2e82f2715b4684a76e957996658665 P aab8459601b444f285b4835da122407d: Deleting consensus metadata
I20260811 16:42:26.474967 31915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c27653104ef408eb00a9a044200dbc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:26.475522 32207 tablet_bootstrap.cc:492] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: No bootstrap required, opened a new log
I20260811 16:42:26.475569 32207 ts_tablet_manager.cc:1397] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:26.475684 32207 raft_consensus.cc:348] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.475768 32207 raft_consensus.cc:374] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:26.475790 32207 raft_consensus.cc:729] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf421d7eb0ab44d194bcfff49a1848f8, State: Initialized, Role: FOLLOWER
I20260811 16:42:26.474439 32191 ts_tablet_manager.cc:1918] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:26.475839 32207 consensus_queue.cc:260] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.475889 32191 log.cc:1196] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/fd2e82f2715b4684a76e957996658665
I20260811 16:42:26.475955 32207 ts_tablet_manager.cc:1428] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:26.476064 32210 tablet_bootstrap.cc:492] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618: Bootstrap starting.
I20260811 16:42:26.476186 32191 ts_tablet_manager.cc:1939] T fd2e82f2715b4684a76e957996658665 P 7a2dd5a320ab4e9ab593166f03176618: Deleting consensus metadata
I20260811 16:42:26.476274 32209 tablet_bootstrap.cc:492] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: Bootstrap starting.
I20260811 16:42:26.476447 32210 tablet_bootstrap.cc:654] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:26.476814 32209 tablet_bootstrap.cc:654] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:26.477041 31209 catalog_manager.cc:4841] TS 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535): tablet fd2e82f2715b4684a76e957996658665 (table test-table [id=d8318c8df3164d82acdd7714415ab165]) successfully deleted
I20260811 16:42:26.477072 32210 tablet_bootstrap.cc:492] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618: No bootstrap required, opened a new log
I20260811 16:42:26.477120 32210 ts_tablet_manager.cc:1397] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:26.477233 32210 raft_consensus.cc:348] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.477311 32210 raft_consensus.cc:374] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:26.477329 32210 raft_consensus.cc:729] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2dd5a320ab4e9ab593166f03176618, State: Initialized, Role: FOLLOWER
I20260811 16:42:26.477367 32210 consensus_queue.cc:260] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.477444 32210 ts_tablet_manager.cc:1428] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:26.477846 31211 catalog_manager.cc:4841] TS aab8459601b444f285b4835da122407d (127.27.186.67:45635): tablet fd2e82f2715b4684a76e957996658665 (table test-table [id=d8318c8df3164d82acdd7714415ab165]) successfully deleted
I20260811 16:42:26.478189 32209 tablet_bootstrap.cc:492] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: No bootstrap required, opened a new log
I20260811 16:42:26.478243 32209 ts_tablet_manager.cc:1397] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:26.478442 32209 raft_consensus.cc:348] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.478507 32209 raft_consensus.cc:374] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:26.478521 32209 raft_consensus.cc:729] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab8459601b444f285b4835da122407d, State: Initialized, Role: FOLLOWER
I20260811 16:42:26.478581 32209 consensus_queue.cc:260] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.478690 32209 ts_tablet_manager.cc:1428] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:26.635166 32225 raft_consensus.cc:482] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:26.635318 32225 raft_consensus.cc:504] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.635569 32225 leader_election.cc:288] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535), bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069)
I20260811 16:42:26.635838 31481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c27653104ef408eb00a9a044200dbc5" candidate_uuid: "aab8459601b444f285b4835da122407d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2dd5a320ab4e9ab593166f03176618" is_pre_election: true
I20260811 16:42:26.635844 31711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c27653104ef408eb00a9a044200dbc5" candidate_uuid: "aab8459601b444f285b4835da122407d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" is_pre_election: true
I20260811 16:42:26.635959 31711 raft_consensus.cc:2454] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aab8459601b444f285b4835da122407d in term 0.
I20260811 16:42:26.635993 31481 raft_consensus.cc:2454] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aab8459601b444f285b4835da122407d in term 0.
I20260811 16:42:26.636157 31845 leader_election.cc:302] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aab8459601b444f285b4835da122407d, bf421d7eb0ab44d194bcfff49a1848f8; no voters:
I20260811 16:42:26.636291 32225 raft_consensus.cc:2781] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:26.636343 32225 raft_consensus.cc:482] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:26.636358 32225 raft_consensus.cc:3037] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:26.637111 32225 raft_consensus.cc:504] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.637279 32225 leader_election.cc:288] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [CANDIDATE]: Term 1 election: Requested vote from peers 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535), bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069)
I20260811 16:42:26.637449 31481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c27653104ef408eb00a9a044200dbc5" candidate_uuid: "aab8459601b444f285b4835da122407d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a2dd5a320ab4e9ab593166f03176618"
I20260811 16:42:26.637465 31711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c27653104ef408eb00a9a044200dbc5" candidate_uuid: "aab8459601b444f285b4835da122407d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf421d7eb0ab44d194bcfff49a1848f8"
I20260811 16:42:26.637560 31711 raft_consensus.cc:3037] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:26.637560 31481 raft_consensus.cc:3037] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:26.638360 31481 raft_consensus.cc:2454] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aab8459601b444f285b4835da122407d in term 1.
I20260811 16:42:26.638360 31711 raft_consensus.cc:2454] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aab8459601b444f285b4835da122407d in term 1.
I20260811 16:42:26.638603 31845 leader_election.cc:302] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7a2dd5a320ab4e9ab593166f03176618, aab8459601b444f285b4835da122407d, bf421d7eb0ab44d194bcfff49a1848f8; no voters:
I20260811 16:42:26.638722 32225 raft_consensus.cc:2781] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:26.638813 32225 raft_consensus.cc:686] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 1 LEADER]: Becoming Leader. State: Replica: aab8459601b444f285b4835da122407d, State: Running, Role: LEADER
I20260811 16:42:26.638872 32225 consensus_queue.cc:237] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } }
I20260811 16:42:26.639564 31229 catalog_manager.cc:5495] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d reported cstate change: term changed from 0 to 1, leader changed from <none> to aab8459601b444f285b4835da122407d (127.27.186.67). New cstate: current_term: 1 leader_uuid: "aab8459601b444f285b4835da122407d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aab8459601b444f285b4835da122407d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 45635 } health_report { overall_health: HEALTHY } } }
I20260811 16:42:26.662992 31711 raft_consensus.cc:1261] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Refusing update from remote peer aab8459601b444f285b4835da122407d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:26.662992 31481 raft_consensus.cc:1261] T 4c27653104ef408eb00a9a044200dbc5 P 7a2dd5a320ab4e9ab593166f03176618 [term 1 FOLLOWER]: Refusing update from remote peer aab8459601b444f285b4835da122407d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:26.663257 32225 consensus_queue.cc:1035] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf421d7eb0ab44d194bcfff49a1848f8" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 36069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:26.663357 32218 consensus_queue.cc:1035] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a2dd5a320ab4e9ab593166f03176618" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 45535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:42:26.668079 32165 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 16:42:28.185851 31229 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:28.185978 31229 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48474:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:28.186826 31229 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 58f9dc455c4d4d958288b339881a29dc: Sending DeleteTablet for 3 replicas of tablet 4c27653104ef408eb00a9a044200dbc5
I20260811 16:42:28.187119 31915 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c27653104ef408eb00a9a044200dbc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:28 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:36084
I20260811 16:42:28.187146 31674 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c27653104ef408eb00a9a044200dbc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:28 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:57354
I20260811 16:42:28.187314 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31337
I20260811 16:42:28.187301 31442 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c27653104ef408eb00a9a044200dbc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:28 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:42370
I20260811 16:42:28.192337 32284 tablet_replica.cc:330] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: stopping tablet replica
I20260811 16:42:28.192473 32284 raft_consensus.cc:2229] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:28.192567 32284 raft_consensus.cc:2258] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:28.193747 32284 ts_tablet_manager.cc:1905] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:28.194756 32283 tablet_replica.cc:330] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: stopping tablet replica
I20260811 16:42:28.194916 32283 raft_consensus.cc:2229] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:28.195019 32283 raft_consensus.cc:2258] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:28.195287 32283 ts_tablet_manager.cc:1905] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:28.196213 32284 ts_tablet_manager.cc:1918] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:42:28.196287 32284 log.cc:1196] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/4c27653104ef408eb00a9a044200dbc5
I20260811 16:42:28.196628 32284 ts_tablet_manager.cc:1939] T 4c27653104ef408eb00a9a044200dbc5 P bf421d7eb0ab44d194bcfff49a1848f8: Deleting consensus metadata
I20260811 16:42:28.197042 31215 catalog_manager.cc:4841] TS bf421d7eb0ab44d194bcfff49a1848f8 (127.27.186.66:36069): tablet 4c27653104ef408eb00a9a044200dbc5 (table test-table [id=8d9d206534d549a89bfe76df7514a62a]) successfully deleted
I20260811 16:42:28.197454 32283 ts_tablet_manager.cc:1918] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 16:42:28.197566 32283 log.cc:1196] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/4c27653104ef408eb00a9a044200dbc5
I20260811 16:42:28.197827 32283 ts_tablet_manager.cc:1939] T 4c27653104ef408eb00a9a044200dbc5 P aab8459601b444f285b4835da122407d: Deleting consensus metadata
I20260811 16:42:28.198207 31211 catalog_manager.cc:4841] TS aab8459601b444f285b4835da122407d (127.27.186.67:45635): tablet 4c27653104ef408eb00a9a044200dbc5 (table test-table [id=8d9d206534d549a89bfe76df7514a62a]) successfully deleted
W20260811 16:42:28.204698 31209 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:45535 (error 108)
I20260811 16:42:28.205030 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31572
I20260811 16:42:28.210587 32287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:28.205190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:45535 (local address 127.0.0.1:49014)
0811 16:42:28.210451 (+ 5261us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:28.210527 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:45535: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5222,"thread_start_us":67,"threads_started":1}
W20260811 16:42:28.210860 31209 catalog_manager.cc:4584] TS 7a2dd5a320ab4e9ab593166f03176618 (127.27.186.65:45535): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4c27653104ef408eb00a9a044200dbc5: Network error: Client connection negotiation failed: client connection to 127.27.186.65:45535: connect: Connection refused (error 111)
I20260811 16:42:28.219324 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31809
I20260811 16:42:28.239935 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31175
2026-08-11T16:42:28Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6375 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:28 dist-test-slave-gsp7 krb5kdc[32292](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:28 dist-test-slave-gsp7 krb5kdc[32292](info): set up 2 sockets
Aug 11 16:42:28 dist-test-slave-gsp7 krb5kdc[32292](info): commencing operation
krb5kdc: starting...
W20260811 16:42:29.523136 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:29 dist-test-slave-gsp7 krb5kdc[32292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:29.656347 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35729
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:35729
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:29.739553 32314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:29.739820 32314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:29.739858 32314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:29.741046 32314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:29.741129 32314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:29.741154 32314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:29.741174 32314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:29.741204 32314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:29.742713 32314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:35729
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:29.742997 32314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:29.743247 32314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:29.748611 32324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:29.748639 32329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:29.748637 32323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:29.748710 32314 server_base.cc:1034] running on GCE node
I20260811 16:42:29.749171 32314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:29.749521 32314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:29.750680 32314 hybrid_clock.cc:648] HybridClock initialized: now 1786466549750657 us; error 41 us; skew 500 ppm
Aug 11 16:42:29 dist-test-slave-gsp7 krb5kdc[32292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466549, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:29.753297 32314 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:29.753818 32314 webserver.cc:460] Webserver started at http://127.27.186.126:37553/ using document root <none> and password file <none>
I20260811 16:42:29.754084 32314 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:29.754158 32314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:29.754314 32314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:29.755393 32314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "cb01bb9baa1b4add808f8c2006476e65"
format_stamp: "Formatted at 2026-08-11 16:42:29 on dist-test-slave-gsp7"
server_key: "ecb22756b59a76d0245c0933f0dad0d4"
server_key_iv: "206efbbda24b9a1b2434e714980b3aaa"
server_key_version: "encryptionkey@0"
I20260811 16:42:29.755756 32314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "cb01bb9baa1b4add808f8c2006476e65"
format_stamp: "Formatted at 2026-08-11 16:42:29 on dist-test-slave-gsp7"
server_key: "ecb22756b59a76d0245c0933f0dad0d4"
server_key_iv: "206efbbda24b9a1b2434e714980b3aaa"
server_key_version: "encryptionkey@0"
I20260811 16:42:29.757165 32314 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:29.758064 32340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:29.758265 32314 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:29.758379 32314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "cb01bb9baa1b4add808f8c2006476e65"
format_stamp: "Formatted at 2026-08-11 16:42:29 on dist-test-slave-gsp7"
server_key: "ecb22756b59a76d0245c0933f0dad0d4"
server_key_iv: "206efbbda24b9a1b2434e714980b3aaa"
server_key_version: "encryptionkey@0"
I20260811 16:42:29.758461 32314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:29.779405 32314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:29.781967 32314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:29.782150 32314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:29.787247 32314 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:35729
I20260811 16:42:29.787286 32425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:35729 every 8 connection(s)
I20260811 16:42:29.787724 32314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:29.788615 32426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:29.790987 32426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65: Bootstrap starting.
I20260811 16:42:29.791532 32426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:29.791770 32426 log.cc:824] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:29.792093 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 32314
I20260811 16:42:29.792164 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:29.792368 28393 external_mini_cluster.cc:1428] Setting key c6980d7c9fb05cfa0e762319daf0fafe
I20260811 16:42:29.792737 32426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65: No bootstrap required, opened a new log
I20260811 16:42:29.795258 32426 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb01bb9baa1b4add808f8c2006476e65" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35729 } }
I20260811 16:42:29.795403 32426 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:29.795424 32426 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb01bb9baa1b4add808f8c2006476e65, State: Initialized, Role: FOLLOWER
I20260811 16:42:29.795559 32426 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb01bb9baa1b4add808f8c2006476e65" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35729 } }
I20260811 16:42:29.795640 32426 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:29.795665 32426 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:29.795730 32426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:29.796337 32426 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb01bb9baa1b4add808f8c2006476e65" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35729 } }
I20260811 16:42:29.796429 32426 leader_election.cc:302] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb01bb9baa1b4add808f8c2006476e65; no voters:
I20260811 16:42:29.796624 32426 leader_election.cc:288] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:29.796648 32432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:29.796797 32432 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [term 1 LEADER]: Becoming Leader. State: Replica: cb01bb9baa1b4add808f8c2006476e65, State: Running, Role: LEADER
I20260811 16:42:29.796916 32426 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:29.796944 32432 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb01bb9baa1b4add808f8c2006476e65" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35729 } }
I20260811 16:42:29.797350 32435 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb01bb9baa1b4add808f8c2006476e65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb01bb9baa1b4add808f8c2006476e65" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35729 } } }
I20260811 16:42:29.797331 32432 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb01bb9baa1b4add808f8c2006476e65. Latest consensus state: current_term: 1 leader_uuid: "cb01bb9baa1b4add808f8c2006476e65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb01bb9baa1b4add808f8c2006476e65" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35729 } } }
I20260811 16:42:29.797605 32432 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:29.797827 32435 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:29.797868 32450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:29.798473 32450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 16:42:29 dist-test-slave-gsp7 krb5kdc[32292](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:29.802006 32450 catalog_manager.cc:1347] Generated new cluster ID: ba71b24b55504745b5249541dd403823
I20260811 16:42:29.802068 32450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:29.806104 32430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:29.792978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58804 (local address 127.27.186.126:35729)
0811 16:42:29.793172 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:29.793180 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:29.793207 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:42:29.794167 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:29.794175 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:29.794228 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:29.794375 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:29.795238 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:29.796937 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:29.798243 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:29.798952 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:29.799117 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:29.802046 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:29.802051 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:29.802051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:29.802064 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:29.804172 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:29.804623 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:29.804626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:29.804627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:29.804742 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:29.804980 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:29.804982 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:29.804982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:29.805306 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:29.805499 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:29.805603 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 16:42:29.805748 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":81,"threads_started":1}
I20260811 16:42:29.816821 32450 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:29.817646 32450 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:29.824098 32450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb01bb9baa1b4add808f8c2006476e65: Generated new TSK 0
I20260811 16:42:29.824318 32450 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:29.860121 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35729
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:29.944953 32464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:29.945158 32464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:29.945181 32464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:29.946491 32464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:29.946537 32464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:29.946563 32464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:29.948028 32464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:29.948293 32464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:29.948567 32464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:29.953779 32473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:29.953912 32475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:29.953912 32477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:29.954128 32464 server_base.cc:1034] running on GCE node
I20260811 16:42:29.954361 32464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:29.954658 32464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:29.955821 32464 hybrid_clock.cc:648] HybridClock initialized: now 1786466549955813 us; error 45 us; skew 500 ppm
Aug 11 16:42:29 dist-test-slave-gsp7 krb5kdc[32292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466549, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:29.958411 32464 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:29.958886 32464 webserver.cc:460] Webserver started at http://127.27.186.65:32995/ using document root <none> and password file <none>
I20260811 16:42:29.959144 32464 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:29.959192 32464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:29.959342 32464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:29.960394 32464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "1de6143f3c204b6d8488e96d46ff40a6"
format_stamp: "Formatted at 2026-08-11 16:42:29 on dist-test-slave-gsp7"
server_key: "cfd593ddd760e0d92327cff794737ea2"
server_key_iv: "eed6ddb7d22e9d436034d4c457a14e9e"
server_key_version: "encryptionkey@0"
I20260811 16:42:29.960767 32464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "1de6143f3c204b6d8488e96d46ff40a6"
format_stamp: "Formatted at 2026-08-11 16:42:29 on dist-test-slave-gsp7"
server_key: "cfd593ddd760e0d92327cff794737ea2"
server_key_iv: "eed6ddb7d22e9d436034d4c457a14e9e"
server_key_version: "encryptionkey@0"
I20260811 16:42:29.962407 32464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:29.963202 32490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:29.963385 32464 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:29.963513 32464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "1de6143f3c204b6d8488e96d46ff40a6"
format_stamp: "Formatted at 2026-08-11 16:42:29 on dist-test-slave-gsp7"
server_key: "cfd593ddd760e0d92327cff794737ea2"
server_key_iv: "eed6ddb7d22e9d436034d4c457a14e9e"
server_key_version: "encryptionkey@0"
I20260811 16:42:29.963595 32464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:29.980577 32464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:29.982884 32464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:29.983065 32464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:29.983317 32464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:29.983650 32464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:29.983711 32464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:29.983754 32464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:29.983779 32464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:29.990275 32464 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:44751
I20260811 16:42:29.990326 32682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:44751 every 8 connection(s)
I20260811 16:42:29.990661 32464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:29.996351 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 32464
I20260811 16:42:29.996508 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:29.997079 28393 external_mini_cluster.cc:1428] Setting key e5ffb9f7fd4acaf3090de5ddbe595488
Aug 11 16:42:29 dist-test-slave-gsp7 krb5kdc[32292](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466549, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:30.001890 32430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:29.991474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:58299 (local address 127.27.186.126:35729)
0811 16:42:29.991527 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:29.991529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:29.991875 (+ 346us) server_negotiation.cc:407] Connection header received
0811 16:42:29.992657 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:29.992659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:29.992674 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:29.992740 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:29.994106 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:29.994635 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:29.995843 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:29.996074 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:29.996189 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:29.998834 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:29.998836 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:29.998836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:29.998844 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:30.000331 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:30.000773 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:30.000774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:30.000775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:30.000838 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:30.001113 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:30.001114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:30.001115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:30.001234 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:30.001348 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:30.001702 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 16:42:30.001794 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:42:30.002112 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:29.991496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35729 (local address 127.27.186.65:58299)
0811 16:42:29.991724 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:29.991778 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:29.992531 (+ 753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:29.992815 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:29.992819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:29.993661 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:29.993993 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:29.993999 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:29.994748 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:29.994749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:29.995740 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:29.995742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:29.996207 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:29.996208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:29.996358 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:29.996918 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:29.996930 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:29.998723 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:30.000443 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:30.000451 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:30.000453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:30.000689 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:30.000911 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:30.000911 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:30.000912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:30.001032 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:30.001341 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:30.001349 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:30.001549 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 16:42:30.001681 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 16:42:30.001848 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":96,"threads_started":1}
I20260811 16:42:30.002893 32686 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35729
I20260811 16:42:30.003010 32686 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:30.003196 32686 heartbeater.cc:511] Master 127.27.186.126:35729 requested a full tablet report, sending...
I20260811 16:42:30.003818 32368 ts_manager.cc:194] Registered new tserver with Master: 1de6143f3c204b6d8488e96d46ff40a6 (127.27.186.65:44751)
I20260811 16:42:30.004810 32368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:58299
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:30.029235 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35729
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:30.115793 32692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:30.116015 32692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:30.116039 32692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:30.117202 32692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:30.117245 32692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:30.117273 32692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:30.118800 32692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:30.119007 32692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:30.119195 32692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:30.124500 32701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:30.124531 32700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:30.124601 32704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:30.125054 32692 server_base.cc:1034] running on GCE node
I20260811 16:42:30.125317 32692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:30.125633 32692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:30.126745 32692 hybrid_clock.cc:648] HybridClock initialized: now 1786466550126735 us; error 28 us; skew 500 ppm
Aug 11 16:42:30 dist-test-slave-gsp7 krb5kdc[32292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466550, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:30.129904 32692 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:30.130434 32692 webserver.cc:460] Webserver started at http://127.27.186.66:36033/ using document root <none> and password file <none>
I20260811 16:42:30.130685 32692 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:30.130806 32692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:30.130963 32692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:30.132164 32692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "3539da7e6e674e9d80a4a0535c9b3c57"
format_stamp: "Formatted at 2026-08-11 16:42:30 on dist-test-slave-gsp7"
server_key: "b244401e9e2ce616822f84e0be9e0246"
server_key_iv: "d7eeef201a35981e68386231801fd8a3"
server_key_version: "encryptionkey@0"
I20260811 16:42:30.132597 32692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "3539da7e6e674e9d80a4a0535c9b3c57"
format_stamp: "Formatted at 2026-08-11 16:42:30 on dist-test-slave-gsp7"
server_key: "b244401e9e2ce616822f84e0be9e0246"
server_key_iv: "d7eeef201a35981e68386231801fd8a3"
server_key_version: "encryptionkey@0"
I20260811 16:42:30.134945 32692 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 16:42:30.135999 32719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:30.136196 32692 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:30.136300 32692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "3539da7e6e674e9d80a4a0535c9b3c57"
format_stamp: "Formatted at 2026-08-11 16:42:30 on dist-test-slave-gsp7"
server_key: "b244401e9e2ce616822f84e0be9e0246"
server_key_iv: "d7eeef201a35981e68386231801fd8a3"
server_key_version: "encryptionkey@0"
I20260811 16:42:30.136387 32692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:30.144672 32692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:30.146799 32692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:30.146975 32692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:30.147228 32692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:30.147540 32692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:30.147598 32692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:30.147641 32692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:30.147680 32692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:30.154193 32692 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:45329
I20260811 16:42:30.154239 426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:45329 every 8 connection(s)
I20260811 16:42:30.154598 32692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:30.155599 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 32692
I20260811 16:42:30.155712 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:30.155928 28393 external_mini_cluster.cc:1428] Setting key 986e6a34b406cc3ca805aeca94b4286c
Aug 11 16:42:30 dist-test-slave-gsp7 krb5kdc[32292](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466550, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:30.166931 32430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:30.155321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:44257 (local address 127.27.186.126:35729)
0811 16:42:30.155373 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:30.155375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:30.155606 (+ 231us) server_negotiation.cc:407] Connection header received
0811 16:42:30.156325 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:30.156327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:30.156339 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:30.156414 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:30.157524 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:30.158269 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:30.159435 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:30.159746 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:30.159829 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:30.162789 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:30.162791 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:30.162791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:30.162800 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:30.164885 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:30.165531 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:30.165532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:30.165533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:30.165617 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:30.165996 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:30.165997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:30.165998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:30.166164 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:30.166248 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:30.166696 (+ 448us) server_negotiation.cc:299] Negotiation successful
0811 16:42:30.166806 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:42:30.167255 430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:30.155269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35729 (local address 127.27.186.66:44257)
0811 16:42:30.155458 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:30.155502 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:30.156219 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:30.156510 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:30.156514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:30.157201 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:30.157405 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:30.157410 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:30.158373 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:30.158374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:30.159330 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:30.159333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:30.159903 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:30.159905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:30.160101 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:30.160865 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:30.160874 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:30.162688 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:30.164991 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:30.165002 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:30.165005 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:30.165392 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:30.165709 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:30.165710 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:30.165710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:30.165890 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:30.166271 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:30.166280 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:30.166481 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 16:42:30.166647 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 16:42:30.166875 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":104,"threads_started":1}
I20260811 16:42:30.168083 427 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35729
I20260811 16:42:30.168217 427 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:30.168452 427 heartbeater.cc:511] Master 127.27.186.126:35729 requested a full tablet report, sending...
I20260811 16:42:30.169008 32368 ts_manager.cc:194] Registered new tserver with Master: 3539da7e6e674e9d80a4a0535c9b3c57 (127.27.186.66:45329)
I20260811 16:42:30.169633 32368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:44257
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:30.200187 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35729
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:30.290894 435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:30.291121 435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:30.291147 435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:30.292364 435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:30.292421 435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:30.292484 435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:30.294020 435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:30.294296 435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:30.294555 435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:30.301115 443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:30.301123 447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:30.301316 435 server_base.cc:1034] running on GCE node
W20260811 16:42:30.301146 441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:30.301743 435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:30.302016 435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:30.303257 435 hybrid_clock.cc:648] HybridClock initialized: now 1786466550303241 us; error 58 us; skew 500 ppm
Aug 11 16:42:30 dist-test-slave-gsp7 krb5kdc[32292](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466550, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:30.306321 435 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:30.306797 435 webserver.cc:460] Webserver started at http://127.27.186.67:42525/ using document root <none> and password file <none>
I20260811 16:42:30.307018 435 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:30.307063 435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:30.307157 435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:30.308244 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "e4eec98b129e4b5aa2bae3691c241922"
format_stamp: "Formatted at 2026-08-11 16:42:30 on dist-test-slave-gsp7"
server_key: "104932a47d6ec498203451bc89823b8b"
server_key_iv: "a3354b4fd6bc01cdb7d6e99625cf8e25"
server_key_version: "encryptionkey@0"
I20260811 16:42:30.308585 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "e4eec98b129e4b5aa2bae3691c241922"
format_stamp: "Formatted at 2026-08-11 16:42:30 on dist-test-slave-gsp7"
server_key: "104932a47d6ec498203451bc89823b8b"
server_key_iv: "a3354b4fd6bc01cdb7d6e99625cf8e25"
server_key_version: "encryptionkey@0"
I20260811 16:42:30.310048 435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:30.310883 455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:30.311129 435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:30.311223 435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "e4eec98b129e4b5aa2bae3691c241922"
format_stamp: "Formatted at 2026-08-11 16:42:30 on dist-test-slave-gsp7"
server_key: "104932a47d6ec498203451bc89823b8b"
server_key_iv: "a3354b4fd6bc01cdb7d6e99625cf8e25"
server_key_version: "encryptionkey@0"
I20260811 16:42:30.311309 435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:30.323617 435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:30.326087 435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:30.326212 435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:30.326423 435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:30.326763 435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:30.326809 435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:30.326858 435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:30.326885 435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:30.332926 435 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:45619
I20260811 16:42:30.333037 647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:45619 every 8 connection(s)
I20260811 16:42:30.333385 435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:30.337285 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 435
I20260811 16:42:30.337363 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:30.337574 28393 external_mini_cluster.cc:1428] Setting key 3a63188e5744eeb20a1e7b96a3a811a1
Aug 11 16:42:30 dist-test-slave-gsp7 krb5kdc[32292](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466550, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:30.343618 32430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:30.334269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:41601 (local address 127.27.186.126:35729)
0811 16:42:30.334337 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:30.334339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:30.334578 (+ 239us) server_negotiation.cc:407] Connection header received
0811 16:42:30.335071 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:30.335072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:30.335081 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:30.335137 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:30.336083 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:30.336584 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:30.337714 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:30.337919 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:30.338013 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:30.340318 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:30.340320 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:30.340320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:30.340328 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:30.341909 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:30.342586 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:30.342588 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:30.342588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:30.342655 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:30.342943 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:30.342944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:30.342945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:30.343065 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:30.343148 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:30.343434 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 16:42:30.343518 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:42:30.343827 650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:30.334245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35729 (local address 127.27.186.67:41601)
0811 16:42:30.334448 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:30.334486 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:30.334987 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:30.335203 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:30.335207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:30.335797 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:30.335996 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:30.336001 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:30.336678 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:30.336678 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:30.337635 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:30.337638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:30.338027 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:30.338029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:30.338166 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:30.338723 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:30.338731 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:30.340189 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:30.342017 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:30.342024 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:30.342026 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:30.342469 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:30.342731 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:30.342732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:30.342732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:30.342851 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:30.343139 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:30.343146 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:30.343292 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 16:42:30.343410 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 16:42:30.343587 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":116,"threads_started":1}
I20260811 16:42:30.344383 648 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35729
I20260811 16:42:30.344504 648 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:30.344671 648 heartbeater.cc:511] Master 127.27.186.126:35729 requested a full tablet report, sending...
I20260811 16:42:30.345058 32368 ts_manager.cc:194] Registered new tserver with Master: e4eec98b129e4b5aa2bae3691c241922 (127.27.186.67:45619)
I20260811 16:42:30.345518 32368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:41601
I20260811 16:42:30.349139 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:42:30.363032 32430 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:30.361982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58818 (local address 127.27.186.126:35729)
0811 16:42:30.362060 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:30.362062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:30.362222 (+ 160us) server_negotiation.cc:407] Connection header received
0811 16:42:30.362264 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:30.362265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:30.362276 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:30.362365 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:30.362924 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58818: BlockingRecv error: recv got EOF from 127.0.0.1:58818 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:42:30.363983 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 32464
I20260811 16:42:30.378479 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 32692
I20260811 16:42:30.394980 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 435
I20260811 16:42:30.418823 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 32314
2026-08-11T16:42:30Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2175 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:30 dist-test-slave-gsp7 krb5kdc[671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:30 dist-test-slave-gsp7 krb5kdc[671](info): set up 2 sockets
Aug 11 16:42:30 dist-test-slave-gsp7 krb5kdc[671](info): commencing operation
krb5kdc: starting...
W20260811 16:42:31.698577 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:31 dist-test-slave-gsp7 krb5kdc[671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:31.828997 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:42505
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:31.915539 689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:31.915802 689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:31.915855 689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:31.917052 689 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:31.917127 689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:31.917153 689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:31.917186 689 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:31.917212 689 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:31.918831 689 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:42505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:42505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:31.919116 689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:31.919363 689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:31.924567 703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:31.924664 700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:31.924677 699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:31.924916 689 server_base.cc:1034] running on GCE node
I20260811 16:42:31.925186 689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:31.925554 689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:31.926745 689 hybrid_clock.cc:648] HybridClock initialized: now 1786466551926727 us; error 54 us; skew 500 ppm
Aug 11 16:42:31 dist-test-slave-gsp7 krb5kdc[671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466551, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:31.932600 689 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:31.933027 689 webserver.cc:460] Webserver started at http://127.27.186.126:38683/ using document root <none> and password file <none>
I20260811 16:42:31.933282 689 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:31.933331 689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:31.933631 689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:31.934772 689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "c8e97e1367384a6492e30a5c4cd556d6"
format_stamp: "Formatted at 2026-08-11 16:42:31 on dist-test-slave-gsp7"
server_key: "413423dd0d4eda37c4354ab2296419a9"
server_key_iv: "2596ac960c678f5d3148234728120018"
server_key_version: "encryptionkey@0"
I20260811 16:42:31.935148 689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "c8e97e1367384a6492e30a5c4cd556d6"
format_stamp: "Formatted at 2026-08-11 16:42:31 on dist-test-slave-gsp7"
server_key: "413423dd0d4eda37c4354ab2296419a9"
server_key_iv: "2596ac960c678f5d3148234728120018"
server_key_version: "encryptionkey@0"
I20260811 16:42:31.936579 689 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:31.937609 713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:31.937814 689 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:31.937932 689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "c8e97e1367384a6492e30a5c4cd556d6"
format_stamp: "Formatted at 2026-08-11 16:42:31 on dist-test-slave-gsp7"
server_key: "413423dd0d4eda37c4354ab2296419a9"
server_key_iv: "2596ac960c678f5d3148234728120018"
server_key_version: "encryptionkey@0"
I20260811 16:42:31.938030 689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:31.956269 689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:31.958982 689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:31.959184 689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:31.963883 689 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:42505
I20260811 16:42:31.963932 804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:42505 every 8 connection(s)
I20260811 16:42:31.964586 689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:31.964844 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 689
I20260811 16:42:31.964960 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:31.965153 28393 external_mini_cluster.cc:1428] Setting key 6b1e09f72764f01dee1f6098034e3383
I20260811 16:42:31.965476 806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:31.968683 806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6: Bootstrap starting.
I20260811 16:42:31.969406 806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:31.969769 806 log.cc:824] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:31.970710 806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6: No bootstrap required, opened a new log
Aug 11 16:42:31 dist-test-slave-gsp7 krb5kdc[671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:31.972780 806 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e97e1367384a6492e30a5c4cd556d6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42505 } }
I20260811 16:42:31.972968 806 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:31.973013 806 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e97e1367384a6492e30a5c4cd556d6, State: Initialized, Role: FOLLOWER
I20260811 16:42:31.973147 806 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e97e1367384a6492e30a5c4cd556d6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42505 } }
I20260811 16:42:31.973240 806 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:31.973313 806 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:31.973371 806 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:31.974138 806 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e97e1367384a6492e30a5c4cd556d6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42505 } }
I20260811 16:42:31.974231 806 leader_election.cc:302] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8e97e1367384a6492e30a5c4cd556d6; no voters:
I20260811 16:42:31.974440 806 leader_election.cc:288] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:31.974502 811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:31.974704 811 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [term 1 LEADER]: Becoming Leader. State: Replica: c8e97e1367384a6492e30a5c4cd556d6, State: Running, Role: LEADER
I20260811 16:42:31.974745 806 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:31.974879 811 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e97e1367384a6492e30a5c4cd556d6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42505 } }
I20260811 16:42:31.975294 814 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8e97e1367384a6492e30a5c4cd556d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e97e1367384a6492e30a5c4cd556d6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42505 } } }
I20260811 16:42:31.975378 814 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:31.975610 827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:31.976148 827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:31.976349 812 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8e97e1367384a6492e30a5c4cd556d6. Latest consensus state: current_term: 1 leader_uuid: "c8e97e1367384a6492e30a5c4cd556d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8e97e1367384a6492e30a5c4cd556d6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42505 } } }
I20260811 16:42:31.976657 812 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:31.977088 809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:31.965923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58072 (local address 127.27.186.126:42505)
0811 16:42:31.966132 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:31.966141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:31.966168 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:42:31.966795 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:31.966803 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:31.966855 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:31.967028 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:31.967741 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:31.968654 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:31.969533 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:31.970082 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:31.970215 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:31.972687 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:31.972693 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:31.972693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:31.972710 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:31.974877 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:31.975340 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:31.975342 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:31.975343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:31.975458 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:31.975728 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:31.975729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:31.975729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:31.976037 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:31.976704 (+ 667us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:31.976779 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 16:42:31.976925 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":94,"threads_started":1}
I20260811 16:42:31.977854 827 catalog_manager.cc:1347] Generated new cluster ID: 36873adb377047c394201d609c4271c4
I20260811 16:42:31.977941 827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:31.978139 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:42:31.991585 827 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:31.992265 827 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:31.994524 809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:31.990311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58080 (local address 127.27.186.126:42505)
0811 16:42:31.990369 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:31.990372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:31.990529 (+ 157us) server_negotiation.cc:407] Connection header received
0811 16:42:31.990606 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:31.990607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:31.990620 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:31.990688 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:31.991103 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:31.991781 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:31.992822 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:31.993149 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:31.993186 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:31.994039 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:31.994040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:31.994040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:31.994256 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:31.994273 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:31.994280 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:31.994307 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:31.994411 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 16:42:31.994451 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:42:31.997406 827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8e97e1367384a6492e30a5c4cd556d6: Generated new TSK 0
I20260811 16:42:31.997628 827 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:42:32.003466 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 689
2026-08-11T16:42:32Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1586 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:32 dist-test-slave-gsp7 krb5kdc[854](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:32 dist-test-slave-gsp7 krb5kdc[854](info): set up 2 sockets
Aug 11 16:42:32 dist-test-slave-gsp7 krb5kdc[854](info): commencing operation
krb5kdc: starting...
W20260811 16:42:33.280073 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:33 dist-test-slave-gsp7 krb5kdc[854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:33.408951 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35221
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:35221
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:33.494083 870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:33.494331 870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:33.494371 870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:33.495544 870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:33.495618 870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:33.495643 870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:33.495672 870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:33.495703 870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:33.497191 870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:35221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:33.497515 870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:33.497771 870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:33.503127 880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:33.503144 876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:33.503207 870 server_base.cc:1034] running on GCE node
W20260811 16:42:33.503151 877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:33.503698 870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:33.504011 870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:33.505193 870 hybrid_clock.cc:648] HybridClock initialized: now 1786466553505182 us; error 30 us; skew 500 ppm
Aug 11 16:42:33 dist-test-slave-gsp7 krb5kdc[854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466553, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:33.507884 870 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:33.508297 870 webserver.cc:460] Webserver started at http://127.27.186.126:35359/ using document root <none> and password file <none>
I20260811 16:42:33.508507 870 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:33.508549 870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:33.508641 870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:33.509759 870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "0028a72284204dd3b89f87d891de266e"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "1f75e742ec7a6ff049c0531025158dac"
server_key_iv: "b989b4853ee6bfbc2959f9934057a025"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.510105 870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "0028a72284204dd3b89f87d891de266e"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "1f75e742ec7a6ff049c0531025158dac"
server_key_iv: "b989b4853ee6bfbc2959f9934057a025"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.511549 870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:33.512291 889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:33.512493 870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:33.512578 870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "0028a72284204dd3b89f87d891de266e"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "1f75e742ec7a6ff049c0531025158dac"
server_key_iv: "b989b4853ee6bfbc2959f9934057a025"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.512645 870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:33.528616 870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:33.531186 870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:33.531304 870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:33.535480 870 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:35221
I20260811 16:42:33.535538 966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:35221 every 8 connection(s)
I20260811 16:42:33.535898 870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:33.537302 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:33.539860 969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e: Bootstrap starting.
I20260811 16:42:33.540552 969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:33.540958 969 log.cc:824] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:33.541903 969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e: No bootstrap required, opened a new log
I20260811 16:42:33.543720 969 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0028a72284204dd3b89f87d891de266e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35221 } }
I20260811 16:42:33.543884 969 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:33.543910 969 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0028a72284204dd3b89f87d891de266e, State: Initialized, Role: FOLLOWER
I20260811 16:42:33.544114 969 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0028a72284204dd3b89f87d891de266e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35221 } }
I20260811 16:42:33.544203 969 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:33.544229 969 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:33.544305 969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:33.544760 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 870
I20260811 16:42:33.544883 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:33.545120 28393 external_mini_cluster.cc:1428] Setting key 355fcd68c65045da63ea793a0f3fa786
I20260811 16:42:33.545607 969 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0028a72284204dd3b89f87d891de266e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35221 } }
I20260811 16:42:33.545728 969 leader_election.cc:302] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0028a72284204dd3b89f87d891de266e; no voters:
I20260811 16:42:33.545929 969 leader_election.cc:288] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:33.545964 974 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:33.546168 974 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [term 1 LEADER]: Becoming Leader. State: Replica: 0028a72284204dd3b89f87d891de266e, State: Running, Role: LEADER
I20260811 16:42:33.546293 969 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:33.546317 974 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0028a72284204dd3b89f87d891de266e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35221 } }
I20260811 16:42:33.546700 974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0028a72284204dd3b89f87d891de266e. Latest consensus state: current_term: 1 leader_uuid: "0028a72284204dd3b89f87d891de266e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0028a72284204dd3b89f87d891de266e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35221 } } }
I20260811 16:42:33.546800 974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:33.547341 976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0028a72284204dd3b89f87d891de266e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0028a72284204dd3b89f87d891de266e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35221 } } }
I20260811 16:42:33.547457 976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e [sys.catalog]: This master's current role is: LEADER
W20260811 16:42:33.549583 992 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:33.549815 992 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:33.549952 979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:33.550216 979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:33.551944 979 catalog_manager.cc:1347] Generated new cluster ID: f2ba93305a7b402d810bdd2aded694de
I20260811 16:42:33.552011 979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:42:33 dist-test-slave-gsp7 krb5kdc[854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:33.556946 979 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:33.557749 979 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:33.558311 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:33.545734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40490 (local address 127.27.186.126:35221)
0811 16:42:33.545949 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:33.545958 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:33.545999 (+ 41us) server_negotiation.cc:407] Connection header received
0811 16:42:33.546150 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:33.546159 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:33.546222 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:33.546427 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:33.547352 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.548653 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.549913 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.550581 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.550711 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:33.553827 (+ 3116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:33.553831 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:33.553831 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:33.553843 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:33.556070 (+ 2227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:33.556526 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:33.556536 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:33.556536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:33.556628 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:33.556868 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:33.556870 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:33.556871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:33.557169 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:33.557347 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:33.557937 (+ 590us) server_negotiation.cc:299] Negotiation successful
0811 16:42:33.558093 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":121,"threads_started":1}
I20260811 16:42:33.573635 979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0028a72284204dd3b89f87d891de266e: Generated new TSK 0
I20260811 16:42:33.573935 979 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:33.609311 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35221
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:33.693296 1000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:33.693586 1000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:33.693629 1000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:33.694878 1000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:33.694940 1000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:33.694988 1000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:33.696448 1000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:33.696712 1000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:33.696952 1000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:42:33.702327 1000 server_base.cc:1034] running on GCE node
W20260811 16:42:33.702358 1011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:33.702445 1010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:33.702308 1014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:33.702702 1000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:33.702909 1000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:33.704054 1000 hybrid_clock.cc:648] HybridClock initialized: now 1786466553704040 us; error 32 us; skew 500 ppm
Aug 11 16:42:33 dist-test-slave-gsp7 krb5kdc[854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466553, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:33.706734 1000 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:33.707177 1000 webserver.cc:460] Webserver started at http://127.27.186.65:33335/ using document root <none> and password file <none>
I20260811 16:42:33.707408 1000 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:33.707453 1000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:33.707621 1000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:33.708750 1000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "8e92453d30164b8a82b30fb1e74a13f3"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "8c5783ee32a51a60d369a7cb7d635720"
server_key_iv: "1a33a3ed17c96c5f2a785bec8d65ec8b"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.709112 1000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "8e92453d30164b8a82b30fb1e74a13f3"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "8c5783ee32a51a60d369a7cb7d635720"
server_key_iv: "1a33a3ed17c96c5f2a785bec8d65ec8b"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.710610 1000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:33.711328 1024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:33.711537 1000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:33.711638 1000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "8e92453d30164b8a82b30fb1e74a13f3"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "8c5783ee32a51a60d369a7cb7d635720"
server_key_iv: "1a33a3ed17c96c5f2a785bec8d65ec8b"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.711711 1000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:33.726869 1000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:33.728960 1000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:33.729084 1000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:33.729280 1000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:33.729657 1000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:33.729696 1000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:33.729719 1000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:33.729768 1000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:33.736181 1000 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:40229
I20260811 16:42:33.736239 1186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:40229 every 8 connection(s)
I20260811 16:42:33.736560 1000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:42:33 dist-test-slave-gsp7 krb5kdc[854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466553, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:33.745368 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 1000
I20260811 16:42:33.745540 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:33.745739 28393 external_mini_cluster.cc:1428] Setting key a67da9c4188f304af9438de157497d0a
I20260811 16:42:33.746253 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:33.737348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:54223 (local address 127.27.186.126:35221)
0811 16:42:33.737454 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:33.737457 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:33.737671 (+ 214us) server_negotiation.cc:407] Connection header received
0811 16:42:33.738282 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:33.738283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:33.738297 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:33.738351 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:33.739386 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.739899 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.740926 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.741145 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.741224 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:33.743437 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:33.743438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:33.743438 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:33.743446 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:33.744735 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:33.745144 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:33.745146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:33.745146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:33.745209 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:33.745470 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:33.745471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:33.745471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:33.745640 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:33.745704 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:33.746104 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 16:42:33.746187 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 16:42:33.746413 1190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:33.737303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35221 (local address 127.27.186.65:54223)
0811 16:42:33.737529 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:33.737581 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:33.738163 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:33.738428 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:33.738432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:33.739060 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:33.739251 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:33.739255 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.740000 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.740001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:33.740806 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:33.740808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.741233 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.741233 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:33.741364 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:33.741936 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:33.741944 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:33.743334 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:33.744822 (+ 1488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:33.744829 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:33.744832 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:33.745062 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:33.745277 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:33.745278 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:33.745278 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:33.745390 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:33.745705 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:33.745713 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:33.745899 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 16:42:33.746017 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 16:42:33.746183 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":93,"threads_started":1}
I20260811 16:42:33.746879 1188 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35221
I20260811 16:42:33.746994 1188 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:33.747205 1188 heartbeater.cc:511] Master 127.27.186.126:35221 requested a full tablet report, sending...
I20260811 16:42:33.747783 917 ts_manager.cc:194] Registered new tserver with Master: 8e92453d30164b8a82b30fb1e74a13f3 (127.27.186.65:40229)
I20260811 16:42:33.748561 917 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:54223
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:33.773311 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35221
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:33.857636 1193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:33.857856 1193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:33.857888 1193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:33.859061 1193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:33.859107 1193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:33.859171 1193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:33.860631 1193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:33.860837 1193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:33.861025 1193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:33.866216 1202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:33.866259 1203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:33.866218 1205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:33.866515 1193 server_base.cc:1034] running on GCE node
I20260811 16:42:33.866701 1193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:33.866961 1193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:33.868145 1193 hybrid_clock.cc:648] HybridClock initialized: now 1786466553868127 us; error 28 us; skew 500 ppm
Aug 11 16:42:33 dist-test-slave-gsp7 krb5kdc[854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466553, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:33.870793 1193 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:33.871264 1193 webserver.cc:460] Webserver started at http://127.27.186.66:42989/ using document root <none> and password file <none>
I20260811 16:42:33.871469 1193 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:33.871511 1193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:33.871603 1193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:33.872637 1193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "83202eaed64d4486b52cbcf5c6cfb075"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "bd8492604731538c087c909b3635102b"
server_key_iv: "208eee01302a9230b7b5fb94cd2e38a4"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.872975 1193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "83202eaed64d4486b52cbcf5c6cfb075"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "bd8492604731538c087c909b3635102b"
server_key_iv: "208eee01302a9230b7b5fb94cd2e38a4"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.876282 1193 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 16:42:33.877122 1214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:33.877316 1193 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:33.877429 1193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "83202eaed64d4486b52cbcf5c6cfb075"
format_stamp: "Formatted at 2026-08-11 16:42:33 on dist-test-slave-gsp7"
server_key: "bd8492604731538c087c909b3635102b"
server_key_iv: "208eee01302a9230b7b5fb94cd2e38a4"
server_key_version: "encryptionkey@0"
I20260811 16:42:33.877534 1193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:33.918537 1193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:33.921034 1193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:33.921213 1193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:33.921497 1193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:33.921823 1193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:33.921875 1193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:33.921919 1193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:33.921963 1193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:33.928200 1193 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:37309
I20260811 16:42:33.928263 1384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:37309 every 8 connection(s)
I20260811 16:42:33.928579 1193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:33.929382 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 1193
I20260811 16:42:33.929528 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:33.929738 28393 external_mini_cluster.cc:1428] Setting key 97aeb84a6d1b79a62256bab11c1f3a01
Aug 11 16:42:33 dist-test-slave-gsp7 krb5kdc[854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466553, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
I20260811 16:42:33.939468 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:33.929342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:42591 (local address 127.27.186.126:35221)
0811 16:42:33.929389 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:33.929392 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:33.929691 (+ 299us) server_negotiation.cc:407] Connection header received
0811 16:42:33.930375 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:33.930376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:33.930388 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:33.930437 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:33.931799 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.932283 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.933418 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.933696 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.933808 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:33.936434 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:33.936435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:33.936436 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:33.936443 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:33.937971 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:33.938401 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:33.938403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:33.938403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:33.938468 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:33.938745 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:33.938746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:33.938746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:33.938867 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:33.938944 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:33.939286 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 16:42:33.939372 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:42:33.939689 1387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:33.929347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35221 (local address 127.27.186.66:42591)
0811 16:42:33.929543 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:33.929594 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:33.930258 (+ 664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:33.930508 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:33.930512 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:33.931409 (+ 897us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:33.931688 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:33.931694 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.932376 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.932377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:33.933317 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:33.933320 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:33.933813 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:33.933814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:33.933968 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:33.934536 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:33.934545 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:33.936317 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:33.938076 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:33.938084 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:33.938087 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:33.938317 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:33.938538 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:33.938539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:33.938539 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:33.938667 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:33.938936 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:33.938943 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:33.939131 (+ 188us) client_negotiation.cc:769] Sending connection context
0811 16:42:33.939251 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 16:42:33.939420 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":99,"threads_started":1}
I20260811 16:42:33.940196 1385 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35221
I20260811 16:42:33.940303 1385 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:33.940474 1385 heartbeater.cc:511] Master 127.27.186.126:35221 requested a full tablet report, sending...
I20260811 16:42:33.940804 917 ts_manager.cc:194] Registered new tserver with Master: 83202eaed64d4486b52cbcf5c6cfb075 (127.27.186.66:37309)
I20260811 16:42:33.941234 917 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:42591
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:33.959100 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35221
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:34.045631 1392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:34.045842 1392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:34.045866 1392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:34.047214 1392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:34.047262 1392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:34.047290 1392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:34.048929 1392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:34.049176 1392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:34.049427 1392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:34.054739 1398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:34.054739 1397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:34.054764 1402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:34.055362 1392 server_base.cc:1034] running on GCE node
I20260811 16:42:34.055626 1392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:34.055850 1392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:34.057015 1392 hybrid_clock.cc:648] HybridClock initialized: now 1786466554057000 us; error 29 us; skew 500 ppm
Aug 11 16:42:34 dist-test-slave-gsp7 krb5kdc[854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466554, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:34.059877 1392 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:34.060397 1392 webserver.cc:460] Webserver started at http://127.27.186.67:34641/ using document root <none> and password file <none>
I20260811 16:42:34.060629 1392 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:34.060676 1392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:34.060832 1392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:34.062021 1392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "040ee27b181a4321be534c6faab0d664"
format_stamp: "Formatted at 2026-08-11 16:42:34 on dist-test-slave-gsp7"
server_key: "dd4bd25c16ede9b2acb53f975eeec85f"
server_key_iv: "0781645c0a8ffe521c9b568b4ecc14c8"
server_key_version: "encryptionkey@0"
I20260811 16:42:34.062405 1392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "040ee27b181a4321be534c6faab0d664"
format_stamp: "Formatted at 2026-08-11 16:42:34 on dist-test-slave-gsp7"
server_key: "dd4bd25c16ede9b2acb53f975eeec85f"
server_key_iv: "0781645c0a8ffe521c9b568b4ecc14c8"
server_key_version: "encryptionkey@0"
I20260811 16:42:34.063778 1392 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:34.064507 1410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:34.064666 1392 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:34.064764 1392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "040ee27b181a4321be534c6faab0d664"
format_stamp: "Formatted at 2026-08-11 16:42:34 on dist-test-slave-gsp7"
server_key: "dd4bd25c16ede9b2acb53f975eeec85f"
server_key_iv: "0781645c0a8ffe521c9b568b4ecc14c8"
server_key_version: "encryptionkey@0"
I20260811 16:42:34.064821 1392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:34.075893 1392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:34.078250 1392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:34.078366 1392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:34.078553 1392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:34.078881 1392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:34.078918 1392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:34.078940 1392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:34.078994 1392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:34.085006 1392 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:44643
I20260811 16:42:34.085098 1596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:44643 every 8 connection(s)
I20260811 16:42:34.085417 1392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:42:34 dist-test-slave-gsp7 krb5kdc[854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466554, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:34.094843 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 1392
I20260811 16:42:34.094949 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:34.094996 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:34.086238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:47001 (local address 127.27.186.126:35221)
0811 16:42:34.086313 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:34.086315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:34.086540 (+ 225us) server_negotiation.cc:407] Connection header received
0811 16:42:34.087060 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:34.087062 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:34.087072 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:34.087140 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:34.088118 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:34.088665 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:34.089747 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:34.089950 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:34.090028 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:34.092189 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:34.092191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:34.092191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:34.092198 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:34.093707 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:34.094109 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:34.094110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:34.094110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:34.094162 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:34.094384 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:34.094385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:34.094385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:34.094489 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:34.094541 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:34.094809 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 16:42:34.094903 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:42:34.095150 28393 external_mini_cluster.cc:1428] Setting key f761f8763cc7c398869f15bd74c4e275
I20260811 16:42:34.095273 1602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:34.086217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:35221 (local address 127.27.186.67:47001)
0811 16:42:34.086407 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:34.086452 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:34.086972 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:34.087216 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:34.087220 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:34.087817 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:34.088034 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:34.088040 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:34.088749 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:34.088750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:34.089661 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:34.089664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:34.090044 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:34.090044 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:34.090153 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:34.090676 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:34.090684 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:34.092083 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:34.093783 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:34.093791 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:34.093793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:34.094038 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:34.094223 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:34.094223 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:34.094224 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:34.094320 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:34.094545 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:34.094550 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:34.094662 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 16:42:34.094781 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 16:42:34.094943 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":111,"threads_started":1}
I20260811 16:42:34.095824 1597 heartbeater.cc:347] Connected to a master server at 127.27.186.126:35221
I20260811 16:42:34.095948 1597 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:34.096174 1597 heartbeater.cc:511] Master 127.27.186.126:35221 requested a full tablet report, sending...
I20260811 16:42:34.096557 916 ts_manager.cc:194] Registered new tserver with Master: 040ee27b181a4321be534c6faab0d664 (127.27.186.67:44643)
I20260811 16:42:34.096906 916 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:47001
I20260811 16:42:34.107177 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:42:34 dist-test-slave-gsp7 krb5kdc[854](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466554, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 16:42:34 dist-test-slave-gsp7 krb5kdc[854](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466554, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:34.133080 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:34.125208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40500 (local address 127.27.186.126:35221)
0811 16:42:34.125280 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:34.125283 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:34.125437 (+ 154us) server_negotiation.cc:407] Connection header received
0811 16:42:34.125569 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:34.125570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:34.125580 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:34.125627 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:34.126337 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:34.126835 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:34.127623 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:34.127802 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:34.127854 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:34.130282 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:34.130283 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:34.130284 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:34.130291 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:34.131819 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:34.132201 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:34.132202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:34.132202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:34.132252 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:34.132528 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:34.132530 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:34.132530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:34.132723 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:34.132827 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:34.132939 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 16:42:34.133008 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 16:42:34.133409 916 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40500
I20260811 16:42:34.134006 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 1000
I20260811 16:42:34.173898 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 1193
I20260811 16:42:34.186226 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 1392
I20260811 16:42:34.198884 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 870
2026-08-11T16:42:34Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2192 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:34 dist-test-slave-gsp7 krb5kdc[1613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:34 dist-test-slave-gsp7 krb5kdc[1613](info): set up 2 sockets
Aug 11 16:42:34 dist-test-slave-gsp7 krb5kdc[1613](info): commencing operation
krb5kdc: starting...
W20260811 16:42:35.484483 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:35 dist-test-slave-gsp7 krb5kdc[1613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:35.616640 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45229
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:39527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:45229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:35.700171 1637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:35.700407 1637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:35.700433 1637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:35.701579 1637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:35.701617 1637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:35.701630 1637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:35.701643 1637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:35.701655 1637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:35.703135 1637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:45229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:35.703325 1637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:35.703508 1637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:35.708846 1647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:35.708846 1649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:35.708941 1637 server_base.cc:1034] running on GCE node
W20260811 16:42:35.708901 1645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:35.709362 1637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:35.709805 1637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:35.710970 1637 hybrid_clock.cc:648] HybridClock initialized: now 1786466555710939 us; error 37 us; skew 500 ppm
Aug 11 16:42:35 dist-test-slave-gsp7 krb5kdc[1613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466555, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:35.713647 1637 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:35.714056 1637 webserver.cc:460] Webserver started at http://127.27.186.126:43317/ using document root <none> and password file <none>
I20260811 16:42:35.714262 1637 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:35.714303 1637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:35.714392 1637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:35.715447 1637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "6eac404a6f8c43b28b96d88b330d8964"
format_stamp: "Formatted at 2026-08-11 16:42:35 on dist-test-slave-gsp7"
server_key: "4482a805cc4479bb87aee29e2239394e"
server_key_iv: "b04915419b5f37f067dc258a09a718f3"
server_key_version: "encryptionkey@0"
I20260811 16:42:35.715766 1637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "6eac404a6f8c43b28b96d88b330d8964"
format_stamp: "Formatted at 2026-08-11 16:42:35 on dist-test-slave-gsp7"
server_key: "4482a805cc4479bb87aee29e2239394e"
server_key_iv: "b04915419b5f37f067dc258a09a718f3"
server_key_version: "encryptionkey@0"
I20260811 16:42:35.717144 1637 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:42:35.717942 1657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:35.718102 1637 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:35.718199 1637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "6eac404a6f8c43b28b96d88b330d8964"
format_stamp: "Formatted at 2026-08-11 16:42:35 on dist-test-slave-gsp7"
server_key: "4482a805cc4479bb87aee29e2239394e"
server_key_iv: "b04915419b5f37f067dc258a09a718f3"
server_key_version: "encryptionkey@0"
I20260811 16:42:35.718257 1637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:35.742142 1637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:35.744230 1637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:35.744374 1637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:35.748543 1637 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:45229
I20260811 16:42:35.748642 1754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:45229 every 8 connection(s)
I20260811 16:42:35.749159 1637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:35.749969 1756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:35.752214 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 1637
I20260811 16:42:35.752344 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:35.752548 28393 external_mini_cluster.cc:1428] Setting key 6ea8822fe66e5391ad84c8b408131364
I20260811 16:42:35.753068 1756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964: Bootstrap starting.
I20260811 16:42:35.753924 1756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:35.754350 1756 log.cc:824] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:35.755291 1756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964: No bootstrap required, opened a new log
I20260811 16:42:35.757862 1756 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eac404a6f8c43b28b96d88b330d8964" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45229 } }
I20260811 16:42:35.758050 1756 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:35.758105 1756 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6eac404a6f8c43b28b96d88b330d8964, State: Initialized, Role: FOLLOWER
I20260811 16:42:35.758327 1756 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eac404a6f8c43b28b96d88b330d8964" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45229 } }
I20260811 16:42:35.758445 1756 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:35.758489 1756 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:35.758553 1756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:35.759445 1756 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eac404a6f8c43b28b96d88b330d8964" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45229 } }
I20260811 16:42:35.759589 1756 leader_election.cc:302] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6eac404a6f8c43b28b96d88b330d8964; no voters:
I20260811 16:42:35.759790 1756 leader_election.cc:288] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:35.759860 1764 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:35.760069 1764 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [term 1 LEADER]: Becoming Leader. State: Replica: 6eac404a6f8c43b28b96d88b330d8964, State: Running, Role: LEADER
I20260811 16:42:35.760102 1756 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:35.760244 1764 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eac404a6f8c43b28b96d88b330d8964" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45229 } }
I20260811 16:42:35.760705 1766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6eac404a6f8c43b28b96d88b330d8964" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eac404a6f8c43b28b96d88b330d8964" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45229 } } }
I20260811 16:42:35.760793 1766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [sys.catalog]: This master's current role is: LEADER
Aug 11 16:42:35 dist-test-slave-gsp7 krb5kdc[1613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:35.761003 1768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6eac404a6f8c43b28b96d88b330d8964. Latest consensus state: current_term: 1 leader_uuid: "6eac404a6f8c43b28b96d88b330d8964" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6eac404a6f8c43b28b96d88b330d8964" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45229 } } }
I20260811 16:42:35.761076 1768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:35.761664 1774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:35.762308 1774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:35.764557 1774 catalog_manager.cc:1347] Generated new cluster ID: d3881843a821442fa5fc63f97e2b3e47
I20260811 16:42:35.764622 1774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:35.765905 1760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:35.753198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41772 (local address 127.27.186.126:45229)
0811 16:42:35.753469 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:35.753502 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:35.753538 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:42:35.754082 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:35.754093 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:35.754170 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:35.754307 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:35.755219 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:35.756183 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:35.757587 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:35.758034 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:35.758196 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:35.761578 (+ 3382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:35.761583 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:35.761583 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:35.761595 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:35.764041 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:35.764502 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:35.764505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:35.764506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:35.764606 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:35.764893 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:35.764894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:35.764895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:35.765160 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:35.765331 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:35.765467 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:42:35.765664 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":157,"threads_started":1}
I20260811 16:42:35.775027 1774 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:35.775833 1774 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:35.779336 1774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6eac404a6f8c43b28b96d88b330d8964: Generated new TSK 0
I20260811 16:42:35.779579 1774 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:35.817224 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45229
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:39527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:35.907939 1801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:35.908198 1801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:35.908241 1801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:35.909454 1801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:35.909544 1801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:35.909591 1801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:35.911180 1801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:35.911491 1801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:35.911739 1801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:35.917217 1808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:35.917218 1806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:35.917217 1810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:35.917388 1801 server_base.cc:1034] running on GCE node
I20260811 16:42:35.917721 1801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:35.918002 1801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:35.919210 1801 hybrid_clock.cc:648] HybridClock initialized: now 1786466555919186 us; error 41 us; skew 500 ppm
Aug 11 16:42:35 dist-test-slave-gsp7 krb5kdc[1613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466555, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:35.922191 1801 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:35.922727 1801 webserver.cc:460] Webserver started at http://127.27.186.65:41859/ using document root <none> and password file <none>
I20260811 16:42:35.922988 1801 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:35.923060 1801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:35.923213 1801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:35.924297 1801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "4a360e26aeb54838894be2bcdb623849"
format_stamp: "Formatted at 2026-08-11 16:42:35 on dist-test-slave-gsp7"
server_key: "b5bb6266deac8717e1fb021099d9dff1"
server_key_iv: "98ad48c5235f02675171734293482bee"
server_key_version: "encryptionkey@0"
I20260811 16:42:35.924688 1801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "4a360e26aeb54838894be2bcdb623849"
format_stamp: "Formatted at 2026-08-11 16:42:35 on dist-test-slave-gsp7"
server_key: "b5bb6266deac8717e1fb021099d9dff1"
server_key_iv: "98ad48c5235f02675171734293482bee"
server_key_version: "encryptionkey@0"
I20260811 16:42:35.926162 1801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:35.927027 1822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:35.927253 1801 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:35.927349 1801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "4a360e26aeb54838894be2bcdb623849"
format_stamp: "Formatted at 2026-08-11 16:42:35 on dist-test-slave-gsp7"
server_key: "b5bb6266deac8717e1fb021099d9dff1"
server_key_iv: "98ad48c5235f02675171734293482bee"
server_key_version: "encryptionkey@0"
I20260811 16:42:35.927457 1801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:35.940215 1801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:35.942690 1801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:35.942919 1801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:35.943220 1801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:35.943610 1801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:35.943673 1801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:35.943722 1801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:35.943748 1801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:35.951535 1801 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:36617
I20260811 16:42:35.951596 1991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:36617 every 8 connection(s)
I20260811 16:42:35.952013 1801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:35.954276 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 1801
I20260811 16:42:35.954418 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:35.954618 28393 external_mini_cluster.cc:1428] Setting key 9f91484cf486ad3dcbd1283ab3f3f5db
Aug 11 16:42:35 dist-test-slave-gsp7 krb5kdc[1613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466555, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:35.962782 1760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:35.952873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:34017 (local address 127.27.186.126:45229)
0811 16:42:35.952970 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:35.952973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:35.953165 (+ 192us) server_negotiation.cc:407] Connection header received
0811 16:42:35.954229 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:35.954231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:35.954245 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:35.954301 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:35.955167 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:35.955786 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:35.956835 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:35.957173 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:35.957251 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:35.959607 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:35.959609 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:35.959609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:35.959618 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:35.961130 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:35.961709 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:35.961710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:35.961711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:35.961776 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:35.962050 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:35.962051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:35.962052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:35.962205 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:35.962270 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:35.962590 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 16:42:35.962685 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 16:42:35.962981 1995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:35.952828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45229 (local address 127.27.186.65:34017)
0811 16:42:35.953028 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:35.953070 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:35.954089 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:35.954384 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:35.954388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:35.954766 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:35.955069 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:35.955075 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:35.955894 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:35.955895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:35.956738 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:35.956740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:35.957288 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:35.957289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:35.957415 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:35.958079 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:35.958087 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:35.959499 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:35.961212 (+ 1713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:35.961221 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:35.961224 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:35.961617 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:35.961847 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:35.961848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:35.961848 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:35.961972 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:35.962261 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:35.962269 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:35.962437 (+ 168us) client_negotiation.cc:769] Sending connection context
0811 16:42:35.962553 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 16:42:35.962724 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":111,"threads_started":1}
I20260811 16:42:35.963469 1992 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45229
I20260811 16:42:35.963591 1992 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:35.963793 1992 heartbeater.cc:511] Master 127.27.186.126:45229 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
I20260811 16:42:35.964367 1693 ts_manager.cc:194] Registered new tserver with Master: 4a360e26aeb54838894be2bcdb623849 (127.27.186.65:36617)
I20260811 16:42:35.965010 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:34017
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:35.984709 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45229
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:39527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:36.073522 2004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:36.073740 2004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:36.073764 2004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:36.074874 2004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:36.074908 2004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:36.074934 2004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:36.076413 2004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:36.076606 2004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:36.076787 2004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:36.082150 2023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:36.082207 2015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:36.082177 2018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:36.082338 2004 server_base.cc:1034] running on GCE node
I20260811 16:42:36.082525 2004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:36.082721 2004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:36.083868 2004 hybrid_clock.cc:648] HybridClock initialized: now 1786466556083858 us; error 33 us; skew 500 ppm
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[1613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466556, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:36.086580 2004 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:36.087069 2004 webserver.cc:460] Webserver started at http://127.27.186.66:39687/ using document root <none> and password file <none>
I20260811 16:42:36.087312 2004 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:36.087358 2004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:36.087530 2004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:36.088636 2004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "e59d8b0b415c47bd9765a728f84d3be7"
format_stamp: "Formatted at 2026-08-11 16:42:36 on dist-test-slave-gsp7"
server_key: "101c03ab1b6d2b2f4902eccdb8a97f7a"
server_key_iv: "cc17358a22ce558edcc46df51c472d55"
server_key_version: "encryptionkey@0"
I20260811 16:42:36.089003 2004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "e59d8b0b415c47bd9765a728f84d3be7"
format_stamp: "Formatted at 2026-08-11 16:42:36 on dist-test-slave-gsp7"
server_key: "101c03ab1b6d2b2f4902eccdb8a97f7a"
server_key_iv: "cc17358a22ce558edcc46df51c472d55"
server_key_version: "encryptionkey@0"
I20260811 16:42:36.090538 2004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:36.091382 2033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:36.091632 2004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:36.091732 2004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "e59d8b0b415c47bd9765a728f84d3be7"
format_stamp: "Formatted at 2026-08-11 16:42:36 on dist-test-slave-gsp7"
server_key: "101c03ab1b6d2b2f4902eccdb8a97f7a"
server_key_iv: "cc17358a22ce558edcc46df51c472d55"
server_key_version: "encryptionkey@0"
I20260811 16:42:36.091809 2004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:36.104605 2004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:36.107421 2004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:36.107623 2004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:36.107914 2004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:36.108279 2004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:36.108330 2004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:36.108389 2004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:36.108420 2004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:36.115257 2004 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:44171
I20260811 16:42:36.115332 2208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:44171 every 8 connection(s)
I20260811 16:42:36.115705 2004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:36.120929 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 2004
I20260811 16:42:36.121065 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:36.121254 28393 external_mini_cluster.cc:1428] Setting key 3a362981314701056328c6e792835550
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[1613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466556, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:36.126595 1760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:36.116551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:49981 (local address 127.27.186.126:45229)
0811 16:42:36.116630 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:36.116632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:36.116905 (+ 273us) server_negotiation.cc:407] Connection header received
0811 16:42:36.118081 (+ 1176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:36.118082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:36.118093 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:36.118151 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:36.118881 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.119392 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.120523 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.120735 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.120812 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:36.123445 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:36.123447 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:36.123447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:36.123455 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:36.124951 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:36.125542 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:36.125543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:36.125544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:36.125611 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:36.125892 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:36.125893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:36.125893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:36.126019 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:36.126100 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:36.126402 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 16:42:36.126501 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:42:36.126788 2213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:36.116526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45229 (local address 127.27.186.66:49981)
0811 16:42:36.116763 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:36.116806 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:36.117967 (+ 1161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:36.118249 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:36.118253 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:36.118571 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:36.118787 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:36.118791 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.119488 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.119490 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:36.120439 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:36.120442 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.120838 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.120839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:36.120967 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:36.121740 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:36.121749 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:36.123351 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:36.125063 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:36.125070 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:36.125073 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:36.125404 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:36.125686 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:36.125687 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:36.125687 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:36.125811 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:36.126092 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:36.126100 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:36.126254 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 16:42:36.126362 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:42:36.126544 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":131,"threads_started":1}
I20260811 16:42:36.127363 2209 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45229
I20260811 16:42:36.127458 2209 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:36.127661 2209 heartbeater.cc:511] Master 127.27.186.126:45229 requested a full tablet report, sending...
I20260811 16:42:36.128095 1693 ts_manager.cc:194] Registered new tserver with Master: e59d8b0b415c47bd9765a728f84d3be7 (127.27.186.66:44171)
I20260811 16:42:36.128475 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:49981
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:36.151762 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45229
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:39527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:36.240417 2219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:36.240644 2219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:36.240671 2219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:36.241873 2219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:36.241910 2219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:36.241937 2219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:36.243585 2219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:36.243799 2219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:36.244000 2219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:36.249315 2229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:36.249301 2228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:36.249415 2219 server_base.cc:1034] running on GCE node
W20260811 16:42:36.249409 2232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:36.249862 2219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:36.250139 2219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:36.251307 2219 hybrid_clock.cc:648] HybridClock initialized: now 1786466556251302 us; error 41 us; skew 500 ppm
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[1613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466556, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:36.254212 2219 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:36.254776 2219 webserver.cc:460] Webserver started at http://127.27.186.67:38121/ using document root <none> and password file <none>
I20260811 16:42:36.255013 2219 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:36.255065 2219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:36.255220 2219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:36.256341 2219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "fa779287532c4377a0ac1ae26e365a93"
format_stamp: "Formatted at 2026-08-11 16:42:36 on dist-test-slave-gsp7"
server_key: "78ceb331511fa5008a256af99e68204a"
server_key_iv: "3b610433c77c5d125437052947641697"
server_key_version: "encryptionkey@0"
I20260811 16:42:36.256733 2219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "fa779287532c4377a0ac1ae26e365a93"
format_stamp: "Formatted at 2026-08-11 16:42:36 on dist-test-slave-gsp7"
server_key: "78ceb331511fa5008a256af99e68204a"
server_key_iv: "3b610433c77c5d125437052947641697"
server_key_version: "encryptionkey@0"
I20260811 16:42:36.258285 2219 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:36.259160 2242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:36.259423 2219 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:36.259506 2219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "fa779287532c4377a0ac1ae26e365a93"
format_stamp: "Formatted at 2026-08-11 16:42:36 on dist-test-slave-gsp7"
server_key: "78ceb331511fa5008a256af99e68204a"
server_key_iv: "3b610433c77c5d125437052947641697"
server_key_version: "encryptionkey@0"
I20260811 16:42:36.259603 2219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:36.277897 2219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:36.280212 2219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:36.280375 2219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:36.280654 2219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:36.280979 2219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:36.281036 2219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:36.281080 2219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:36.281107 2219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:36.287676 2219 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:37771
I20260811 16:42:36.287724 2409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:37771 every 8 connection(s)
I20260811 16:42:36.288082 2219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[1613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466556, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:36.297968 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 2219
I20260811 16:42:36.298074 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:36.298264 28393 external_mini_cluster.cc:1428] Setting key 52e4991b7b358f2aa00f40d3b4420a60
I20260811 16:42:36.298440 1760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:36.288892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:59195 (local address 127.27.186.126:45229)
0811 16:42:36.288945 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:36.288947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:36.289184 (+ 237us) server_negotiation.cc:407] Connection header received
0811 16:42:36.290423 (+ 1239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:36.290425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:36.290440 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:36.290492 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:36.291229 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.291792 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.292922 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.293156 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.293238 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:36.295600 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:36.295601 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:36.295602 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:36.295610 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:36.296926 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:36.297357 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:36.297358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:36.297359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:36.297423 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:36.297717 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:36.297718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:36.297718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:36.297863 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:36.297944 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:36.298255 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 16:42:36.298342 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:42:36.298645 2412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:36.288850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45229 (local address 127.27.186.67:59195)
0811 16:42:36.289048 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:36.289089 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:36.290284 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:36.290585 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:36.290595 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:36.290877 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:36.291108 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:36.291113 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.291902 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.291903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:36.292807 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:36.292810 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.293262 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.293263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:36.293407 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:36.294003 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:36.294013 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:36.295484 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:36.297013 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:36.297021 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:36.297023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:36.297261 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:36.297522 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:36.297522 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:36.297523 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:36.297636 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:36.297935 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:36.297943 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:36.298116 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 16:42:36.298221 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 16:42:36.298398 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":86,"threads_started":1}
I20260811 16:42:36.299265 2410 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45229
I20260811 16:42:36.299376 2410 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:36.299563 2410 heartbeater.cc:511] Master 127.27.186.126:45229 requested a full tablet report, sending...
I20260811 16:42:36.299985 1693 ts_manager.cc:194] Registered new tserver with Master: fa779287532c4377a0ac1ae26e365a93 (127.27.186.67:37771)
I20260811 16:42:36.300462 1693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:59195
I20260811 16:42:36.310803 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[1613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[1613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:36.336911 2421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:36.327950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43978 (local address 127.27.186.65:36617)
0811 16:42:36.328162 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:36.328167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:36.328177 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:36.328206 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:36.328208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:36.328224 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:36.328345 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:36.329018 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.329923 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.330788 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.331217 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.331311 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:36.333914 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:36.333925 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:36.333926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:36.333935 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:36.335533 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:36.335945 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:36.335948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:36.335949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:36.336028 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:36.336257 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:36.336258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:36.336258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:36.336473 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:36.336623 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:36.336736 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 16:42:36.336803 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":71,"threads_started":1}
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[1613](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:36.345377 1760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:36.338551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41786 (local address 127.27.186.126:45229)
0811 16:42:36.338620 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:36.338622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:36.338632 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:36.338698 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:36.338699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:36.338708 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:36.338761 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:36.339282 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.339832 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.340522 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:36.340722 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:36.340784 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:36.343013 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:36.343015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:36.343015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:36.343023 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:36.344436 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:36.344718 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:36.344719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:36.344719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:36.344769 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:36.344910 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:36.344910 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:36.344911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:36.345046 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:36.345121 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:36.345211 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 16:42:36.345268 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 16:42:36.345705 1693 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41786
I20260811 16:42:36.346079 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 1801
I20260811 16:42:36.359055 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 2004
I20260811 16:42:36.380154 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 2219
I20260811 16:42:36.394161 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 1637
2026-08-11T16:42:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2195 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[2429](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[2429](info): set up 2 sockets
Aug 11 16:42:36 dist-test-slave-gsp7 krb5kdc[2429](info): commencing operation
krb5kdc: starting...
W20260811 16:42:37.672670 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:37 dist-test-slave-gsp7 krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:37.826179 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:33173
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:33173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:37.911450 2448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:37.911717 2448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:37.911760 2448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:37.913028 2448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:37.913106 2448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:37.913134 2448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:37.913167 2448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:37.913201 2448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:37.914861 2448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:33173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:33173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:37.915171 2448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:37.915422 2448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:37.921028 2459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:37.921068 2460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:37.921108 2448 server_base.cc:1034] running on GCE node
W20260811 16:42:37.921068 2462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:37.921581 2448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:37.921880 2448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:37.923024 2448 hybrid_clock.cc:648] HybridClock initialized: now 1786466557923008 us; error 30 us; skew 500 ppm
Aug 11 16:42:37 dist-test-slave-gsp7 krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466557, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:37.925729 2448 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:37.926098 2448 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:37.926179 2448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:37.926334 2448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:37.927446 2448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "e8bef85358294af1b59187150de5d3c7"
format_stamp: "Formatted at 2026-08-11 16:42:37 on dist-test-slave-gsp7"
server_key: "117101728ac03adbbdb061384c66c2b8"
server_key_iv: "6a9fbe10b4d8cd3105a3ec1484d82467"
server_key_version: "encryptionkey@0"
I20260811 16:42:37.927837 2448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "e8bef85358294af1b59187150de5d3c7"
format_stamp: "Formatted at 2026-08-11 16:42:37 on dist-test-slave-gsp7"
server_key: "117101728ac03adbbdb061384c66c2b8"
server_key_iv: "6a9fbe10b4d8cd3105a3ec1484d82467"
server_key_version: "encryptionkey@0"
I20260811 16:42:37.929250 2448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:37.930174 2471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:37.930413 2448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:37.930536 2448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "e8bef85358294af1b59187150de5d3c7"
format_stamp: "Formatted at 2026-08-11 16:42:37 on dist-test-slave-gsp7"
server_key: "117101728ac03adbbdb061384c66c2b8"
server_key_iv: "6a9fbe10b4d8cd3105a3ec1484d82467"
server_key_version: "encryptionkey@0"
I20260811 16:42:37.930619 2448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:37.946168 2448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:37.948585 2448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:37.948781 2448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:37.953372 2448 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:33173
I20260811 16:42:37.953393 2557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:33173 every 8 connection(s)
I20260811 16:42:37.953761 2448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:37.955065 2558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:37.957697 2558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7: Bootstrap starting.
I20260811 16:42:37.958334 2558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:37.958608 2558 log.cc:824] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:37.959403 2558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7: No bootstrap required, opened a new log
I20260811 16:42:37.961014 2558 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8bef85358294af1b59187150de5d3c7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33173 } }
I20260811 16:42:37.961164 2558 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:37.961189 2558 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8bef85358294af1b59187150de5d3c7, State: Initialized, Role: FOLLOWER
I20260811 16:42:37.961294 2558 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8bef85358294af1b59187150de5d3c7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33173 } }
I20260811 16:42:37.961396 2558 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:37.961455 2558 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:37.961534 2558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:37.962417 2558 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8bef85358294af1b59187150de5d3c7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33173 } }
I20260811 16:42:37.962550 2558 leader_election.cc:302] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8bef85358294af1b59187150de5d3c7; no voters:
I20260811 16:42:37.962755 2558 leader_election.cc:288] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:37.962842 2561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:37.962903 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 2448
I20260811 16:42:37.963025 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:37.963037 2558 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:37.963044 2561 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [term 1 LEADER]: Becoming Leader. State: Replica: e8bef85358294af1b59187150de5d3c7, State: Running, Role: LEADER
I20260811 16:42:37.963192 2561 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8bef85358294af1b59187150de5d3c7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33173 } }
I20260811 16:42:37.963253 28393 external_mini_cluster.cc:1428] Setting key 3b5b2b58a0ea10f1979a4b12664ce892
I20260811 16:42:37.964848 2566 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8bef85358294af1b59187150de5d3c7. Latest consensus state: current_term: 1 leader_uuid: "e8bef85358294af1b59187150de5d3c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8bef85358294af1b59187150de5d3c7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33173 } } }
I20260811 16:42:37.964965 2566 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:37.965152 2562 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8bef85358294af1b59187150de5d3c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8bef85358294af1b59187150de5d3c7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33173 } } }
I20260811 16:42:37.965242 2562 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7 [sys.catalog]: This master's current role is: LEADER
W20260811 16:42:37.965855 2588 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:37.965920 2588 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:37.965986 2591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:37.966152 2591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:37.967818 2591 catalog_manager.cc:1347] Generated new cluster ID: 21e0b27416464d3f9709d5a0529c9e81
I20260811 16:42:37.967877 2591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:42:37 dist-test-slave-gsp7 krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:37.974855 2570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:37.963814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57182 (local address 127.27.186.126:33173)
0811 16:42:37.964034 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:37.964045 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:37.964256 (+ 211us) server_negotiation.cc:407] Connection header received
0811 16:42:37.964494 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:37.964503 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:37.964572 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:37.965351 (+ 779us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:37.965609 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:37.966700 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:37.967606 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:37.968175 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:37.968295 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:37.970745 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:37.970749 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:37.970750 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:37.970762 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:37.973172 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:37.973652 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:37.973655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:37.973655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:37.973743 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:37.973976 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:37.973981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:37.973981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:37.974213 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:37.974390 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:37.974516 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 16:42:37.974666 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":75,"threads_started":1}
I20260811 16:42:37.977090 2591 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:37.977921 2591 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:37.981372 2591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7: Generated new TSK 0
I20260811 16:42:37.981595 2591 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:38.014022 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33173
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:38.106863 2599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:38.107128 2599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:38.107177 2599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:38.108487 2599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:38.108559 2599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:38.108613 2599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:38.110509 2599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:38.110805 2599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:38.111059 2599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:38.116459 2611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:38.116528 2616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:38.116660 2599 server_base.cc:1034] running on GCE node
W20260811 16:42:38.116464 2610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:38.117151 2599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:38.117444 2599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:38.118672 2599 hybrid_clock.cc:648] HybridClock initialized: now 1786466558118656 us; error 32 us; skew 500 ppm
Aug 11 16:42:38 dist-test-slave-gsp7 krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466558, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:38.121672 2599 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:38.122179 2599 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:38.122268 2599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:38.122448 2599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:38.123648 2599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "62f17d621e9742c887045a18f0f70de7"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "2a1e2929f997ac3600b4e07b43c7eb02"
server_key_iv: "21af2f1adaba6760cad22cd943cd17bb"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.124064 2599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "62f17d621e9742c887045a18f0f70de7"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "2a1e2929f997ac3600b4e07b43c7eb02"
server_key_iv: "21af2f1adaba6760cad22cd943cd17bb"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.125624 2599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:38.126533 2625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.126746 2599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:38.126869 2599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "62f17d621e9742c887045a18f0f70de7"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "2a1e2929f997ac3600b4e07b43c7eb02"
server_key_iv: "21af2f1adaba6760cad22cd943cd17bb"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.126972 2599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:38.137985 2599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:38.140657 2599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:38.140826 2599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:38.141089 2599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:38.141435 2599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:38.141522 2599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.141598 2599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:38.141634 2599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.148365 2599 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:41063
I20260811 16:42:38.148473 2807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:41063 every 8 connection(s)
I20260811 16:42:38.148761 2599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:38.150849 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 2599
I20260811 16:42:38.150991 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:38.151188 28393 external_mini_cluster.cc:1428] Setting key 00340303d3bd861c2a9eca5169edc128
Aug 11 16:42:38 dist-test-slave-gsp7 krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466558, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:38.160703 2570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.149604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:60695 (local address 127.27.186.126:33173)
0811 16:42:38.149667 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.149670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.149935 (+ 265us) server_negotiation.cc:407] Connection header received
0811 16:42:38.150560 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.150562 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.150577 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.150643 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:38.151952 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.152511 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.153717 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.154100 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.154191 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.157074 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:38.157075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:38.157076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:38.157086 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:38.158897 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:38.159407 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:38.159408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:38.159409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:38.159479 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:38.159795 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:38.159796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:38.159796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:38.159942 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:38.160024 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.160361 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.160545 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:42:38.160794 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.149598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33173 (local address 127.27.186.65:60695)
0811 16:42:38.149795 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.149835 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.150426 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.150724 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.150740 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.151118 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:38.151843 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.151852 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.152632 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.152633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.153618 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.153621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.154222 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.154223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.154370 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.155030 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:38.155042 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:38.156950 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:38.159021 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:38.159032 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:38.159035 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:38.159304 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:38.159578 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:38.159579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:38.159579 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:38.159709 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:38.160029 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:38.160038 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:38.160201 (+ 163us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.160322 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.160533 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":94,"threads_started":1}
I20260811 16:42:38.161404 2810 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33173
I20260811 16:42:38.161548 2810 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:38.161757 2810 heartbeater.cc:511] Master 127.27.186.126:33173 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
I20260811 16:42:38.162462 2497 ts_manager.cc:194] Registered new tserver with Master: 62f17d621e9742c887045a18f0f70de7 (127.27.186.65:41063)
I20260811 16:42:38.163302 2497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:60695
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:38.185227 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33173
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:38.272205 2815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:38.272418 2815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:38.272444 2815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:38.273665 2815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:38.273708 2815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:38.273736 2815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:38.275358 2815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:38.275641 2815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:38.275920 2815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:38.281284 2827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:38.281240 2822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:38.281263 2825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:38.281665 2815 server_base.cc:1034] running on GCE node
I20260811 16:42:38.281930 2815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:38.282193 2815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:38.283392 2815 hybrid_clock.cc:648] HybridClock initialized: now 1786466558283364 us; error 36 us; skew 500 ppm
Aug 11 16:42:38 dist-test-slave-gsp7 krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466558, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:38.286165 2815 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:38.286494 2815 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:38.286537 2815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:38.286630 2815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:38.287674 2815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "a2c9d94826154184a25f060c3ab5ebbd"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "b028410a2fafe7beaf4cb4243a70c6c5"
server_key_iv: "50cd81d7f5885a70ad6c60ee6b3f85d4"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.287979 2815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "a2c9d94826154184a25f060c3ab5ebbd"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "b028410a2fafe7beaf4cb4243a70c6c5"
server_key_iv: "50cd81d7f5885a70ad6c60ee6b3f85d4"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.289213 2815 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 16:42:38.290030 2838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.290232 2815 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:38.290320 2815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "a2c9d94826154184a25f060c3ab5ebbd"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "b028410a2fafe7beaf4cb4243a70c6c5"
server_key_iv: "50cd81d7f5885a70ad6c60ee6b3f85d4"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.290375 2815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:38.310551 2815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:38.312631 2815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:38.312757 2815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:38.312975 2815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:38.313319 2815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:38.313356 2815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.313380 2815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:38.313429 2815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.319604 2815 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:35009
I20260811 16:42:38.319686 3024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:35009 every 8 connection(s)
I20260811 16:42:38.319962 2815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:38.321704 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 2815
I20260811 16:42:38.321820 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:38.322022 28393 external_mini_cluster.cc:1428] Setting key 9a026b200585cd9485669e0e105aecef
Aug 11 16:42:38 dist-test-slave-gsp7 krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466558, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:38.330787 2570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.320804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:39443 (local address 127.27.186.126:33173)
0811 16:42:38.320867 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.320869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.321065 (+ 196us) server_negotiation.cc:407] Connection header received
0811 16:42:38.321675 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.321676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.321692 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.321779 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:38.322975 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.323489 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.324538 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.324749 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.324827 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.327423 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:38.327425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:38.327425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:38.327434 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:38.329153 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:38.329648 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:38.329650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:38.329651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:38.329720 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:38.329981 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:38.329983 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:38.329983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:38.330151 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:38.330255 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.330569 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.330683 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:42:38.330814 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.320749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33173 (local address 127.27.186.66:39443)
0811 16:42:38.320918 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.320972 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.321551 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.321891 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.321896 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.322244 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:38.322866 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.322872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.323591 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.323593 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.324430 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.324433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.324836 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.324837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.324976 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.325598 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:38.325606 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:38.327312 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:38.329257 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:38.329264 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:38.329266 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:38.329573 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:38.329800 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:38.329801 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:38.329801 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:38.329904 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:38.330219 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:38.330224 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:38.330395 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.330496 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.330629 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
I20260811 16:42:38.331336 3026 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33173
I20260811 16:42:38.331472 3026 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:38.331648 3026 heartbeater.cc:511] Master 127.27.186.126:33173 requested a full tablet report, sending...
I20260811 16:42:38.332052 2497 ts_manager.cc:194] Registered new tserver with Master: a2c9d94826154184a25f060c3ab5ebbd (127.27.186.66:35009)
I20260811 16:42:38.332453 2497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:39443
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:38.352273 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33173
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:38.437456 3038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:38.437762 3038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:38.437808 3038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:38.439028 3038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:38.439093 3038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:38.439138 3038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:38.440702 3038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:38.440972 3038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:38.441277 3038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:38.446730 3050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:38.446816 3046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:38.446715 3038 server_base.cc:1034] running on GCE node
W20260811 16:42:38.446715 3047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:38.447173 3038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:38.447499 3038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:38.448668 3038 hybrid_clock.cc:648] HybridClock initialized: now 1786466558448649 us; error 30 us; skew 500 ppm
Aug 11 16:42:38 dist-test-slave-gsp7 krb5kdc[2429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466558, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:38.451418 3038 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:38.451805 3038 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:38.451881 3038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:38.452039 3038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:38.453140 3038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "0afb3ab931874a41816b861e78ba917d"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "dc2241cd348cc84d4a21ae1f1e61cd82"
server_key_iv: "d76edf8bd0c04c4b8ce3f548d60cac68"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.453588 3038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "0afb3ab931874a41816b861e78ba917d"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "dc2241cd348cc84d4a21ae1f1e61cd82"
server_key_iv: "d76edf8bd0c04c4b8ce3f548d60cac68"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.454934 3038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:38.455711 3059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.455888 3038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:38.455983 3038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "0afb3ab931874a41816b861e78ba917d"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "dc2241cd348cc84d4a21ae1f1e61cd82"
server_key_iv: "d76edf8bd0c04c4b8ce3f548d60cac68"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.456072 3038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:38.483274 3038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:38.485822 3038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:38.486006 3038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:38.486291 3038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:38.486644 3038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:38.486702 3038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.486747 3038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:38.486775 3038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.493822 3038 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:39633
I20260811 16:42:38.493868 3244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:39633 every 8 connection(s)
I20260811 16:42:38.494212 3038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:38.498260 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 3038
I20260811 16:42:38.498383 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:38.498560 28393 external_mini_cluster.cc:1428] Setting key f6086be71ea6e267600b8435344be7a8
Aug 11 16:42:38 dist-test-slave-gsp7 krb5kdc[2429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466558, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:38.504390 2570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.495034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:52247 (local address 127.27.186.126:33173)
0811 16:42:38.495086 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.495088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.495333 (+ 245us) server_negotiation.cc:407] Connection header received
0811 16:42:38.495845 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.495846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.495858 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.495926 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:38.496913 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.497419 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.498660 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.498913 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.498989 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.501352 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:38.501353 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:38.501354 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:38.501361 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:38.502911 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:38.503346 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:38.503347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:38.503347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:38.503414 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:38.503698 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:38.503699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:38.503699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:38.503825 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:38.503901 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.504212 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.504298 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:42:38.504590 3248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.494984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33173 (local address 127.27.186.67:52247)
0811 16:42:38.495184 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.495231 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.495754 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.496014 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.496018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.496289 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:38.496794 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.496816 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.497613 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.497614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.498563 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.498566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.499004 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.499005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.499151 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.499759 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:38.499768 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:38.501236 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:38.503022 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:38.503031 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:38.503033 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:38.503264 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:38.503500 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:38.503501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:38.503502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:38.503620 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:38.503905 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:38.503913 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:38.504066 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.504174 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.504347 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":118,"threads_started":1}
I20260811 16:42:38.505067 3245 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33173
I20260811 16:42:38.505173 3245 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:38.505307 3245 heartbeater.cc:511] Master 127.27.186.126:33173 requested a full tablet report, sending...
I20260811 16:42:38.505721 2497 ts_manager.cc:194] Registered new tserver with Master: 0afb3ab931874a41816b861e78ba917d (127.27.186.67:39633)
I20260811 16:42:38.506076 2497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:52247
I20260811 16:42:38.510242 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:42:38.517812 2570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.511544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57194 (local address 127.27.186.126:33173)
0811 16:42:38.511623 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.511626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.511746 (+ 120us) server_negotiation.cc:407] Connection header received
0811 16:42:38.511832 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.511833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.511844 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.511895 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:38.512470 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.513062 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.513867 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.514059 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.514137 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.515354 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:38.515355 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:38.515356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:38.515364 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:38.516582 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:38.516935 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:38.516937 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:38.516937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:38.516999 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:38.517205 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:38.517206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:38.517206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:38.517363 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:38.517484 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.517624 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.517708 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:42:38.519301 2497 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57194:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:38.520895 2497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:38.527415 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.523616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59072 (local address 127.27.186.66:35009)
0811 16:42:38.523989 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.523993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.524004 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:38.524045 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.524047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.524063 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.524136 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:38.524343 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.525406 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.526544 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.527041 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.527128 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.527185 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.527282 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.527324 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":87,"threads_started":1}
I20260811 16:42:38.527401 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.523379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:35009 (local address 127.0.0.1:59072)
0811 16:42:38.523618 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.523627 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.523665 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.524229 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.524230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.524233 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:38.524268 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.524270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.525533 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.525534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.526444 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.526446 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.527141 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.527142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.527203 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.527207 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.527260 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.527324 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":23,"thread_start_us":75,"threads_started":1}
I20260811 16:42:38.527449 3262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.523312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59674 (local address 127.27.186.67:39633)
0811 16:42:38.523659 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.523664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.523677 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:42:38.523721 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.523723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.523738 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.523820 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:38.523992 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.524832 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.526185 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.526922 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.526969 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.527021 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.527296 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.527343 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":98,"threads_started":1}
I20260811 16:42:38.527565 3260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.523157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:41063 (local address 127.0.0.1:45250)
0811 16:42:38.523368 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.523412 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.523496 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.523797 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.523800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.523802 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:38.523875 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.523877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.525344 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.525345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.526454 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.526456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.527333 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.527334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.527402 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.527406 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.527436 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.527482 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":3,"thread_start_us":81,"threads_started":1}
I20260811 16:42:38.527670 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.523195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:39633 (local address 127.0.0.1:59674)
0811 16:42:38.523471 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.523481 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.523524 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.523833 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.523834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.523837 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:38.523896 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.523899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.524930 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.524930 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.526076 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.526079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.527086 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.527087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.527166 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.527178 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.527560 (+ 382us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.527602 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":97,"threads_started":1}
I20260811 16:42:38.527866 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.523305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45250 (local address 127.27.186.65:41063)
0811 16:42:38.523650 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.523655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.523666 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:38.523706 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.523708 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.523724 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.523797 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:38.523954 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.525223 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.526547 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.527241 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.527658 (+ 417us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.527729 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.527758 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.527800 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":79,"threads_started":1}
I20260811 16:42:38.528465 2927 tablet_service.cc:1467] Processing CreateTablet for tablet 0f52dff892234cec84c85e73afc11fdb (DEFAULT_TABLE table=test-table [id=9db3bda18b7f41218ab7c2eb5fb0ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:38.528645 2696 tablet_service.cc:1467] Processing CreateTablet for tablet 0f52dff892234cec84c85e73afc11fdb (DEFAULT_TABLE table=test-table [id=9db3bda18b7f41218ab7c2eb5fb0ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:38.528647 3135 tablet_service.cc:1467] Processing CreateTablet for tablet 0f52dff892234cec84c85e73afc11fdb (DEFAULT_TABLE table=test-table [id=9db3bda18b7f41218ab7c2eb5fb0ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:38.528852 2927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f52dff892234cec84c85e73afc11fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:38.528996 2696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f52dff892234cec84c85e73afc11fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:38.528996 3135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f52dff892234cec84c85e73afc11fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:38.531940 3267 tablet_bootstrap.cc:492] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Bootstrap starting.
I20260811 16:42:38.532580 3269 tablet_bootstrap.cc:492] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: Bootstrap starting.
I20260811 16:42:38.533051 3267 tablet_bootstrap.cc:654] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:38.533397 3269 tablet_bootstrap.cc:654] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:38.533860 3267 log.cc:824] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:38.534118 3269 log.cc:824] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:38.534300 3272 tablet_bootstrap.cc:492] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7: Bootstrap starting.
I20260811 16:42:38.534818 3267 tablet_bootstrap.cc:492] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: No bootstrap required, opened a new log
I20260811 16:42:38.534897 3269 tablet_bootstrap.cc:492] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: No bootstrap required, opened a new log
I20260811 16:42:38.534898 3267 ts_tablet_manager.cc:1397] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:42:38.534948 3269 ts_tablet_manager.cc:1397] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:42:38.537021 3269 raft_consensus.cc:348] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.537022 3267 raft_consensus.cc:348] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.537213 3267 raft_consensus.cc:374] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:38.537213 3269 raft_consensus.cc:374] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:38.537252 3269 raft_consensus.cc:729] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afb3ab931874a41816b861e78ba917d, State: Initialized, Role: FOLLOWER
I20260811 16:42:38.537252 3267 raft_consensus.cc:729] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2c9d94826154184a25f060c3ab5ebbd, State: Initialized, Role: FOLLOWER
I20260811 16:42:38.537397 3269 consensus_queue.cc:260] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.537397 3267 consensus_queue.cc:260] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.537726 3267 ts_tablet_manager.cc:1428] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:42:38.537726 3269 ts_tablet_manager.cc:1428] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260811 16:42:38.537766 3026 heartbeater.cc:503] Master 127.27.186.126:33173 was elected leader, sending a full tablet report...
I20260811 16:42:38.537864 3245 heartbeater.cc:503] Master 127.27.186.126:33173 was elected leader, sending a full tablet report...
I20260811 16:42:38.538424 3272 tablet_bootstrap.cc:654] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:38.539129 3272 log.cc:824] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:38.539824 3272 tablet_bootstrap.cc:492] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7: No bootstrap required, opened a new log
I20260811 16:42:38.539880 3272 ts_tablet_manager.cc:1397] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260811 16:42:38.541258 3272 raft_consensus.cc:348] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.541498 3272 raft_consensus.cc:374] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:38.541555 3272 raft_consensus.cc:729] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62f17d621e9742c887045a18f0f70de7, State: Initialized, Role: FOLLOWER
I20260811 16:42:38.541684 3272 consensus_queue.cc:260] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.542003 2810 heartbeater.cc:503] Master 127.27.186.126:33173 was elected leader, sending a full tablet report...
I20260811 16:42:38.541990 3272 ts_tablet_manager.cc:1428] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260811 16:42:38.570585 3027 tablet.cc:2369] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:38.573047 3278 raft_consensus.cc:482] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:38.573181 3278 raft_consensus.cc:504] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.573714 3278 leader_election.cc:288] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2c9d94826154184a25f060c3ab5ebbd (127.27.186.66:35009), 0afb3ab931874a41816b861e78ba917d (127.27.186.67:39633)
I20260811 16:42:38.576676 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.573995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:45337 (local address 127.27.186.66:35009)
0811 16:42:38.574097 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.574099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.574107 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:38.574135 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.574136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.574153 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.574221 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:38.574384 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.574877 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.575898 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.576303 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.576395 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.576405 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.576567 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.576602 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 16:42:38.576715 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.573880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:35009 (local address 127.27.186.65:45337)
0811 16:42:38.573943 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.573970 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.574022 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.574227 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.574228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.574230 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:38.574301 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.574303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.574977 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.574979 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.575796 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.575798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.576395 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.576396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.576487 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.576490 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.576559 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.576602 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":30}
I20260811 16:42:38.576732 3262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.573995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:60765 (local address 127.27.186.67:39633)
0811 16:42:38.574045 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.574047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.574207 (+ 160us) server_negotiation.cc:407] Connection header received
0811 16:42:38.574288 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.574289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.574299 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.574370 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:38.574543 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.575000 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.575951 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.576345 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.576445 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.576454 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.576625 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.576665 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:42:38.576972 3279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.573880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:39633 (local address 127.27.186.65:60765)
0811 16:42:38.574125 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.574135 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.574219 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.574375 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.574376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.574378 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:38.574461 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.574463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.575092 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.575093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.575849 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:38.575851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.576445 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.576446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:38.576530 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.576534 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.576603 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.576646 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":22,"thread_start_us":131,"threads_started":1}
I20260811 16:42:38.577107 2952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f52dff892234cec84c85e73afc11fdb" candidate_uuid: "62f17d621e9742c887045a18f0f70de7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c9d94826154184a25f060c3ab5ebbd" is_pre_election: true
I20260811 16:42:38.577288 2952 raft_consensus.cc:2454] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62f17d621e9742c887045a18f0f70de7 in term 0.
I20260811 16:42:38.577399 3169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f52dff892234cec84c85e73afc11fdb" candidate_uuid: "62f17d621e9742c887045a18f0f70de7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afb3ab931874a41816b861e78ba917d" is_pre_election: true
I20260811 16:42:38.577585 3169 raft_consensus.cc:2454] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62f17d621e9742c887045a18f0f70de7 in term 0.
I20260811 16:42:38.577694 2629 leader_election.cc:302] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62f17d621e9742c887045a18f0f70de7, a2c9d94826154184a25f060c3ab5ebbd; no voters:
I20260811 16:42:38.577826 3278 raft_consensus.cc:2781] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:38.577924 3278 raft_consensus.cc:482] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:38.577963 3278 raft_consensus.cc:3037] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:38.578698 3278 raft_consensus.cc:504] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.578863 3278 leader_election.cc:288] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [CANDIDATE]: Term 1 election: Requested vote from peers a2c9d94826154184a25f060c3ab5ebbd (127.27.186.66:35009), 0afb3ab931874a41816b861e78ba917d (127.27.186.67:39633)
I20260811 16:42:38.579027 3169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f52dff892234cec84c85e73afc11fdb" candidate_uuid: "62f17d621e9742c887045a18f0f70de7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0afb3ab931874a41816b861e78ba917d"
I20260811 16:42:38.579082 2952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f52dff892234cec84c85e73afc11fdb" candidate_uuid: "62f17d621e9742c887045a18f0f70de7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2c9d94826154184a25f060c3ab5ebbd"
I20260811 16:42:38.579128 3169 raft_consensus.cc:3037] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:38.579188 2952 raft_consensus.cc:3037] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:38.579936 2952 raft_consensus.cc:2454] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62f17d621e9742c887045a18f0f70de7 in term 1.
I20260811 16:42:38.579989 3169 raft_consensus.cc:2454] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62f17d621e9742c887045a18f0f70de7 in term 1.
I20260811 16:42:38.580150 2629 leader_election.cc:302] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62f17d621e9742c887045a18f0f70de7, a2c9d94826154184a25f060c3ab5ebbd; no voters:
I20260811 16:42:38.580276 3278 raft_consensus.cc:2781] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:38.580441 3278 raft_consensus.cc:686] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [term 1 LEADER]: Becoming Leader. State: Replica: 62f17d621e9742c887045a18f0f70de7, State: Running, Role: LEADER
I20260811 16:42:38.580551 3278 consensus_queue.cc:237] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } }
I20260811 16:42:38.581442 2497 catalog_manager.cc:5495] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62f17d621e9742c887045a18f0f70de7 (127.27.186.65). New cstate: current_term: 1 leader_uuid: "62f17d621e9742c887045a18f0f70de7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "62f17d621e9742c887045a18f0f70de7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 } health_report { overall_health: UNKNOWN } } }
I20260811 16:42:38.589766 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.587522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45258 (local address 127.27.186.65:41063)
0811 16:42:38.587567 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.587569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.587596 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:42:38.587669 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.587670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.587685 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.587742 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:38.587857 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.588300 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.589007 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:38.589180 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:38.589228 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:38.589371 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:38.589530 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:38.589601 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.589644 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.589661 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:42:38.591615 2952 raft_consensus.cc:1261] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 1 FOLLOWER]: Refusing update from remote peer 62f17d621e9742c887045a18f0f70de7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:38.591630 3169 raft_consensus.cc:1261] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 1 FOLLOWER]: Refusing update from remote peer 62f17d621e9742c887045a18f0f70de7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:38.591989 3280 consensus_queue.cc:1035] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0afb3ab931874a41816b861e78ba917d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:38.592126 3278 consensus_queue.cc:1035] T 0f52dff892234cec84c85e73afc11fdb P 62f17d621e9742c887045a18f0f70de7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2c9d94826154184a25f060c3ab5ebbd" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:38.594841 3283 mvcc.cc:205] Tried to move back new op lower bound from 7317367023988166656 to 7317367023946588160. Current Snapshot: MvccSnapshot[applied={T|T < 7317367023988166656 or (T in {7317367023988166656})}]
I20260811 16:42:38.595031 3286 mvcc.cc:205] Tried to move back new op lower bound from 7317367023988166656 to 7317367023946588160. Current Snapshot: MvccSnapshot[applied={T|T < 7317367023988166656}]
I20260811 16:42:38.596943 2496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:38.597050 2496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57194:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:38.597867 2496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e8bef85358294af1b59187150de5d3c7: Sending DeleteTablet for 3 replicas of tablet 0f52dff892234cec84c85e73afc11fdb
I20260811 16:42:38.598233 3135 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f52dff892234cec84c85e73afc11fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:38 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:59674
I20260811 16:42:38.598270 2927 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f52dff892234cec84c85e73afc11fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:38 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:59072
I20260811 16:42:38.598294 2696 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f52dff892234cec84c85e73afc11fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:38 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:45250
I20260811 16:42:38.598583 3300 tablet_replica.cc:330] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: stopping tablet replica
I20260811 16:42:38.598695 3300 raft_consensus.cc:2229] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:38.598757 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 2599
I20260811 16:42:38.598803 3300 raft_consensus.cc:2258] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:38.598800 3301 tablet_replica.cc:330] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: stopping tablet replica
I20260811 16:42:38.598903 3301 raft_consensus.cc:2229] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:38.599009 3301 raft_consensus.cc:2258] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:38.599613 3301 ts_tablet_manager.cc:1905] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:38.601384 3301 ts_tablet_manager.cc:1918] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:38.601540 3301 log.cc:1196] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/0f52dff892234cec84c85e73afc11fdb
I20260811 16:42:38.601879 3301 ts_tablet_manager.cc:1939] T 0f52dff892234cec84c85e73afc11fdb P a2c9d94826154184a25f060c3ab5ebbd: Deleting consensus metadata
I20260811 16:42:38.602348 2476 catalog_manager.cc:4841] TS a2c9d94826154184a25f060c3ab5ebbd (127.27.186.66:35009): tablet 0f52dff892234cec84c85e73afc11fdb (table test-table [id=9db3bda18b7f41218ab7c2eb5fb0ca1d]) successfully deleted
I20260811 16:42:38.608706 3300 ts_tablet_manager.cc:1905] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:38.610716 3300 ts_tablet_manager.cc:1918] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:38.610800 3300 log.cc:1196] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/0f52dff892234cec84c85e73afc11fdb
I20260811 16:42:38.611090 3300 ts_tablet_manager.cc:1939] T 0f52dff892234cec84c85e73afc11fdb P 0afb3ab931874a41816b861e78ba917d: Deleting consensus metadata
I20260811 16:42:38.611594 2473 catalog_manager.cc:4841] TS 0afb3ab931874a41816b861e78ba917d (127.27.186.67:39633): tablet 0f52dff892234cec84c85e73afc11fdb (table test-table [id=9db3bda18b7f41218ab7c2eb5fb0ca1d]) successfully deleted
W20260811 16:42:38.614598 2476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:41063 (error 108)
I20260811 16:42:38.615017 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 2815
I20260811 16:42:38.617658 3263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.615098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:41063 (local address 127.0.0.1:45266)
0811 16:42:38.617529 (+ 2431us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.617586 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:41063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2367}
W20260811 16:42:38.617964 2476 catalog_manager.cc:4584] TS 62f17d621e9742c887045a18f0f70de7 (127.27.186.65:41063): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0f52dff892234cec84c85e73afc11fdb: Network error: Client connection negotiation failed: client connection to 127.27.186.65:41063: connect: Connection refused (error 111)
I20260811 16:42:38.633522 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 3038
I20260811 16:42:38.647141 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 2448
2026-08-11T16:42:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2256 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T16:42:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:38Z Disabled control of system clock
I20260811 16:42:38.686510 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:37433
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:34765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:37433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:42:38.772993 3313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:38.773218 3313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:38.773242 3313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:38.774480 3313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:38.774529 3313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:38.774544 3313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:38.774555 3313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:38.774567 3313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:38.775949 3313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:34765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:37433
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:37433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:38.776233 3313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:38.776556 3313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:38.782070 3322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:38.782078 3323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:38.782078 3327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:38.782133 3313 server_base.cc:1034] running on GCE node
I20260811 16:42:38.782546 3313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:38.782876 3313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:38.784061 3313 hybrid_clock.cc:648] HybridClock initialized: now 1786466558784035 us; error 57 us; skew 500 ppm
I20260811 16:42:38.785549 3313 webserver.cc:460] Webserver started at http://127.27.186.126:34779/ using document root <none> and password file <none>
I20260811 16:42:38.785809 3313 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:38.785887 3313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:38.786041 3313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:38.787171 3313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "aef7369fcb9d4f69b89cbe3da5ddb116"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "c483a2ca5002370e6d88f5d0f669e3d5"
server_key_iv: "adbd57dc0b37c95b615e8875322f5643"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.787575 3313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "aef7369fcb9d4f69b89cbe3da5ddb116"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "c483a2ca5002370e6d88f5d0f669e3d5"
server_key_iv: "adbd57dc0b37c95b615e8875322f5643"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.789029 3313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:38.789927 3335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.790117 3313 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:38.790234 3313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "aef7369fcb9d4f69b89cbe3da5ddb116"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "c483a2ca5002370e6d88f5d0f669e3d5"
server_key_iv: "adbd57dc0b37c95b615e8875322f5643"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.790346 3313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:38.793826 3313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:38.794123 3313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:38.794272 3313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:38.798420 3313 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:37433
I20260811 16:42:38.798454 3418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:37433 every 8 connection(s)
I20260811 16:42:38.798807 3313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:38.799480 3421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:38.801364 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 3313
I20260811 16:42:38.801496 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:38.801678 28393 external_mini_cluster.cc:1428] Setting key eea988e07a281d2447a2dffadc43c9ff
I20260811 16:42:38.802986 3421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116: Bootstrap starting.
I20260811 16:42:38.803720 3421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:38.804131 3421 log.cc:824] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:38.804502 3427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.802265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45442 (local address 127.27.186.126:37433)
0811 16:42:38.802462 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.802470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.802496 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:42:38.802928 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.802935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.803001 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.803168 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:38.803959 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:38.803964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:38.803965 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:38.803971 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:38.804023 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:38.804039 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:38.804142 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.804261 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.804323 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260811 16:42:38.804971 3421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116: No bootstrap required, opened a new log
I20260811 16:42:38.806830 3421 raft_consensus.cc:348] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef7369fcb9d4f69b89cbe3da5ddb116" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37433 } }
I20260811 16:42:38.806979 3421 raft_consensus.cc:374] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:38.807003 3421 raft_consensus.cc:729] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef7369fcb9d4f69b89cbe3da5ddb116, State: Initialized, Role: FOLLOWER
I20260811 16:42:38.807132 3421 consensus_queue.cc:260] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef7369fcb9d4f69b89cbe3da5ddb116" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37433 } }
I20260811 16:42:38.807221 3421 raft_consensus.cc:388] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:38.807243 3421 raft_consensus.cc:482] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:38.807317 3421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:38.807868 3421 raft_consensus.cc:504] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef7369fcb9d4f69b89cbe3da5ddb116" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37433 } }
I20260811 16:42:38.807996 3421 leader_election.cc:302] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aef7369fcb9d4f69b89cbe3da5ddb116; no voters:
I20260811 16:42:38.808182 3421 leader_election.cc:288] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:38.808223 3431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:38.808423 3431 raft_consensus.cc:686] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [term 1 LEADER]: Becoming Leader. State: Replica: aef7369fcb9d4f69b89cbe3da5ddb116, State: Running, Role: LEADER
I20260811 16:42:38.808436 3421 sys_catalog.cc:564] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:38.808544 3431 consensus_queue.cc:237] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef7369fcb9d4f69b89cbe3da5ddb116" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37433 } }
I20260811 16:42:38.808940 3432 sys_catalog.cc:455] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aef7369fcb9d4f69b89cbe3da5ddb116" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef7369fcb9d4f69b89cbe3da5ddb116" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37433 } } }
I20260811 16:42:38.808961 3433 sys_catalog.cc:455] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aef7369fcb9d4f69b89cbe3da5ddb116. Latest consensus state: current_term: 1 leader_uuid: "aef7369fcb9d4f69b89cbe3da5ddb116" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aef7369fcb9d4f69b89cbe3da5ddb116" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37433 } } }
I20260811 16:42:38.809366 3433 sys_catalog.cc:458] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:38.809666 3443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:38.809286 3432 sys_catalog.cc:458] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:38.810241 3443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:38.811713 3443 catalog_manager.cc:1347] Generated new cluster ID: 2840d25bfce24d8ab390c143b302ea35
I20260811 16:42:38.811765 3443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:38.820597 3443 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:38.820798 3443 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:38.824587 3443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116: Generated new TSK 0
I20260811 16:42:38.824785 3443 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:42:38.830889 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37433
--builtin_ntp_servers=127.27.186.84:34765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:42:38.917305 3455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:38.917603 3455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:38.917647 3455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:38.918848 3455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:38.918913 3455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:38.918956 3455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:38.920329 3455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:34765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:38.920616 3455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:38.920943 3455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:42:38.926290 3455 server_base.cc:1034] running on GCE node
W20260811 16:42:38.926363 3461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:38.926409 3462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:38.926479 3464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:38.926776 3455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:38.927086 3455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:38.928274 3455 hybrid_clock.cc:648] HybridClock initialized: now 1786466558928252 us; error 36 us; skew 500 ppm
I20260811 16:42:38.929901 3455 webserver.cc:460] Webserver started at http://127.27.186.65:36217/ using document root <none> and password file <none>
I20260811 16:42:38.930204 3455 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:38.930253 3455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:38.930438 3455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:38.931610 3455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "bb1d65b7328446d6b1d0eeff045ad4a8"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "9aa70ea0c65ee6a15196538806babab2"
server_key_iv: "8b56adace815108d8cd097cd6a615919"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.932031 3455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "bb1d65b7328446d6b1d0eeff045ad4a8"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "9aa70ea0c65ee6a15196538806babab2"
server_key_iv: "8b56adace815108d8cd097cd6a615919"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.933434 3455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:38.934367 3473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.934650 3455 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:38.934767 3455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "bb1d65b7328446d6b1d0eeff045ad4a8"
format_stamp: "Formatted at 2026-08-11 16:42:38 on dist-test-slave-gsp7"
server_key: "9aa70ea0c65ee6a15196538806babab2"
server_key_iv: "8b56adace815108d8cd097cd6a615919"
server_key_version: "encryptionkey@0"
I20260811 16:42:38.934861 3455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:38.938378 3455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:38.938660 3455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:38.938810 3455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:38.939023 3455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:38.939344 3455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:38.939399 3455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.939440 3455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:38.939468 3455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:38.945662 3455 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:37095
I20260811 16:42:38.945709 3646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:37095 every 8 connection(s)
I20260811 16:42:38.946056 3455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:38.946987 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 3455
I20260811 16:42:38.947103 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:38.947327 28393 external_mini_cluster.cc:1428] Setting key b08d248aec74cc8b7bbc79a22c909098
I20260811 16:42:38.948521 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37433
--builtin_ntp_servers=127.27.186.84:34765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 16:42:38.949720 3427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.946934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:41981 (local address 127.27.186.126:37433)
0811 16:42:38.946991 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:38.946993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:38.947298 (+ 305us) server_negotiation.cc:407] Connection header received
0811 16:42:38.947909 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:38.947910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:38.947915 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:38.947984 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:38.949430 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:38.949431 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:38.949432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:38.949436 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:38.949451 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:38.949455 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:38.949570 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:38.949655 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 16:42:38.949667 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:42:38.949967 3649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:38.946893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37433 (local address 127.27.186.65:41981)
0811 16:42:38.947142 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:38.947193 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:38.947804 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:38.948052 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:38.948055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:38.948063 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:38.949245 (+ 1182us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:42:38.949246 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:38.949286 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:42:38.949332 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:38.949574 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:38.949580 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:38.949583 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:38.949667 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:42:38.949731 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":107,"threads_started":1}
I20260811 16:42:38.950599 3647 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37433
I20260811 16:42:38.950704 3647 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:38.950872 3647 heartbeater.cc:511] Master 127.27.186.126:37433 requested a full tablet report, sending...
I20260811 16:42:38.951424 3369 ts_manager.cc:194] Registered new tserver with Master: bb1d65b7328446d6b1d0eeff045ad4a8 (127.27.186.65:37095)
W20260811 16:42:39.035311 3651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:39.035605 3651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:39.035636 3651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:39.037366 3651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:39.037464 3651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:39.037595 3651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:39.039192 3651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:34765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:39.039479 3651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:39.039819 3651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:39.045451 3664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:39.045502 3651 server_base.cc:1034] running on GCE node
W20260811 16:42:39.045518 3661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:39.045424 3660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:39.045961 3651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:39.046237 3651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:39.047422 3651 hybrid_clock.cc:648] HybridClock initialized: now 1786466559047408 us; error 31 us; skew 500 ppm
I20260811 16:42:39.048936 3651 webserver.cc:460] Webserver started at http://127.27.186.66:41121/ using document root <none> and password file <none>
I20260811 16:42:39.049199 3651 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:39.049278 3651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:39.049445 3651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:39.050783 3651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "501c46d46cb24857a3ff488931a0efc2"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "538f15539a1828bccf0e368b0c5751ad"
server_key_iv: "c6bf01980a3a6af4cbd9fba889bbe739"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.051218 3651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "501c46d46cb24857a3ff488931a0efc2"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "538f15539a1828bccf0e368b0c5751ad"
server_key_iv: "c6bf01980a3a6af4cbd9fba889bbe739"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.052656 3651 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:39.053534 3673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:39.053714 3651 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:39.053824 3651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "501c46d46cb24857a3ff488931a0efc2"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "538f15539a1828bccf0e368b0c5751ad"
server_key_iv: "c6bf01980a3a6af4cbd9fba889bbe739"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.053913 3651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:39.057441 3651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:39.057775 3651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:39.057927 3651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:39.058157 3651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:39.058485 3651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:39.058540 3651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:39.058581 3651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:39.058609 3651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:39.065197 3651 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:40545
I20260811 16:42:39.065243 3832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:40545 every 8 connection(s)
I20260811 16:42:39.065680 3651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:39.068658 3427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.066483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:52989 (local address 127.27.186.126:37433)
0811 16:42:39.066571 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.066574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.066787 (+ 213us) server_negotiation.cc:407] Connection header received
0811 16:42:39.067270 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.067271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.067277 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.067332 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.068468 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.068469 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.068470 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.068473 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.068488 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.068491 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.068538 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.068590 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.068602 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:42:39.068854 3835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.066456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37433 (local address 127.27.186.66:52989)
0811 16:42:39.066664 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.066698 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.067176 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.067385 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.067389 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.067396 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:39.068323 (+ 927us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:42:39.068323 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:39.068350 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:42:39.068379 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:39.068543 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:39.068545 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:39.068547 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:42:39.068598 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:42:39.068645 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":107,"threads_started":1}
I20260811 16:42:39.069594 3833 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37433
I20260811 16:42:39.069682 3833 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:39.069798 3833 heartbeater.cc:511] Master 127.27.186.126:37433 requested a full tablet report, sending...
I20260811 16:42:39.070201 3369 ts_manager.cc:194] Registered new tserver with Master: 501c46d46cb24857a3ff488931a0efc2 (127.27.186.66:40545)
I20260811 16:42:39.075042 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 3651
I20260811 16:42:39.075137 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:39.075281 28393 external_mini_cluster.cc:1428] Setting key 79a53f79b0320296e5241ca1267d7b87
I20260811 16:42:39.076367 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37433
--builtin_ntp_servers=127.27.186.84:34765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 16:42:39.163230 3837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:39.163439 3837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:39.163461 3837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:39.164533 3837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:39.164565 3837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:39.164590 3837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:39.165920 3837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:34765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:39.166114 3837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:39.166357 3837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:42:39.171837 3837 server_base.cc:1034] running on GCE node
W20260811 16:42:39.171787 3846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:39.171814 3845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:39.171774 3849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:39.172224 3837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:39.172504 3837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:39.173703 3837 hybrid_clock.cc:648] HybridClock initialized: now 1786466559173686 us; error 26 us; skew 500 ppm
I20260811 16:42:39.175168 3837 webserver.cc:460] Webserver started at http://127.27.186.67:36743/ using document root <none> and password file <none>
I20260811 16:42:39.175422 3837 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:39.175498 3837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:39.175664 3837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:39.176837 3837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "6f6111ff81b991ae33880b8d5152a589"
server_key_iv: "ab3df6c0e3df4319fef8b350f94467a5"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.177255 3837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "6f6111ff81b991ae33880b8d5152a589"
server_key_iv: "ab3df6c0e3df4319fef8b350f94467a5"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.178779 3837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:39.179569 3860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:39.179747 3837 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:39.179862 3837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "6f6111ff81b991ae33880b8d5152a589"
server_key_iv: "ab3df6c0e3df4319fef8b350f94467a5"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.179955 3837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:39.183516 3837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:39.183799 3837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:39.183950 3837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:39.184165 3837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:39.184492 3837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:39.184548 3837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:39.184589 3837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:39.184617 3837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:39.190810 3837 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:41311
I20260811 16:42:39.190862 4022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:41311 every 8 connection(s)
I20260811 16:42:39.191208 3837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:39.192104 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 3837
I20260811 16:42:39.192209 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:39.192376 28393 external_mini_cluster.cc:1428] Setting key 454b3bd5ab93bb8419a221a77b788fa3
I20260811 16:42:39.194696 3427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.192006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:42489 (local address 127.27.186.126:37433)
0811 16:42:39.192085 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.192088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.192284 (+ 196us) server_negotiation.cc:407] Connection header received
0811 16:42:39.192951 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.192952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.192958 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.193009 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.194450 (+ 1441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.194452 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.194452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.194457 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.194474 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.194478 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.194526 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.194609 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.194624 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:42:39.194909 4026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.191947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37433 (local address 127.27.186.67:42489)
0811 16:42:39.192148 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.192190 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.192846 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.193101 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.193105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.193115 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:39.194297 (+ 1182us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:42:39.194297 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:39.194326 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:42:39.194355 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:39.194535 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:39.194541 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:39.194544 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:39.194610 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:42:39.194673 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":102,"threads_started":1}
I20260811 16:42:39.195366 4024 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37433
I20260811 16:42:39.195441 4024 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:39.195621 4024 heartbeater.cc:511] Master 127.27.186.126:37433 requested a full tablet report, sending...
I20260811 16:42:39.196007 3369 ts_manager.cc:194] Registered new tserver with Master: 5c1de7f9f1bd42c8a5eee7887f6b4fe2 (127.27.186.67:41311)
I20260811 16:42:39.204279 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:42:39.206964 3427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.205764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45454 (local address 127.27.186.126:37433)
0811 16:42:39.205835 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.205837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.205981 (+ 144us) server_negotiation.cc:407] Connection header received
0811 16:42:39.206041 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.206042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.206047 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.206107 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.206745 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.206746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.206747 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.206751 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.206768 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.206773 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.206836 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.206889 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.206903 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:42:39.208891 3369 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:39.210917 3369 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:39.214803 4035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.213049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:37095 (local address 127.0.0.1:37732)
0811 16:42:39.213624 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.213670 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.213721 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.214010 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.214016 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.214023 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:39.214505 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:42:39.214505 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:39.214519 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:42:39.214540 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:39.214686 (+ 146us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:39.214689 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:39.214691 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:42:39.214740 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:42:39.214751 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":89,"threads_started":1}
I20260811 16:42:39.214915 4038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.213408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37732 (local address 127.27.186.65:37095)
0811 16:42:39.213834 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.213837 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.213867 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:42:39.213896 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.213898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.213909 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.213988 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.214597 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.214601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.214601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.214604 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.214630 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.214640 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.214689 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.214788 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.214804 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":82,"threads_started":1}
I20260811 16:42:39.215876 3550 tablet_service.cc:1467] Processing CreateTablet for tablet 9e328470825b4ac783038bbfe56f5248 (DEFAULT_TABLE table=test-table [id=5da25324fa5a4f2fa7072d6aee20e8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:39.216208 4032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.213049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:41311 (local address 127.0.0.1:49488)
0811 16:42:39.214762 (+ 1713us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.214774 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.214834 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.215327 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.215328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.215330 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:39.215770 (+ 440us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:42:39.215771 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:39.215778 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:42:39.215791 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:39.216081 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:39.216082 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:39.216082 (+ 0us) client_negotiation.cc:769] Sending connection context
0811 16:42:39.216131 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:42:39.216144 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1697,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260811 16:42:39.216331 3550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e328470825b4ac783038bbfe56f5248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:39.216547 4036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.213265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49488 (local address 127.27.186.67:41311)
0811 16:42:39.213481 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.213487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.214883 (+ 1396us) server_negotiation.cc:407] Connection header received
0811 16:42:39.214920 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.214923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.214935 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.215017 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.215906 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.215915 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.215915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.215920 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.215957 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.215985 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.216049 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.216442 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.216460 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":138,"threads_started":1}
I20260811 16:42:39.216717 4034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.213079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:40545 (local address 127.0.0.1:45594)
0811 16:42:39.214903 (+ 1824us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.214913 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.214952 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.215430 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.215431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.215434 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:39.216322 (+ 888us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:42:39.216322 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:39.216328 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:42:39.216341 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:39.216583 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:39.216584 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:39.216585 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:42:39.216633 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:42:39.216648 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1810,"thread_start_us":116,"threads_started":1}
I20260811 16:42:39.216967 4037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.213384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45594 (local address 127.27.186.66:40545)
0811 16:42:39.213600 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.213603 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.215016 (+ 1413us) server_negotiation.cc:407] Connection header received
0811 16:42:39.215050 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.215052 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.215063 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.215139 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.216420 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.216429 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.216429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.216434 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.216477 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.216510 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.216734 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.216884 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.216900 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":136,"threads_started":1}
I20260811 16:42:39.217160 3934 tablet_service.cc:1467] Processing CreateTablet for tablet 9e328470825b4ac783038bbfe56f5248 (DEFAULT_TABLE table=test-table [id=5da25324fa5a4f2fa7072d6aee20e8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:39.217540 3934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e328470825b4ac783038bbfe56f5248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:39.219986 4040 tablet_bootstrap.cc:492] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8: Bootstrap starting.
I20260811 16:42:39.220651 4040 tablet_bootstrap.cc:654] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:39.220531 3744 tablet_service.cc:1467] Processing CreateTablet for tablet 9e328470825b4ac783038bbfe56f5248 (DEFAULT_TABLE table=test-table [id=5da25324fa5a4f2fa7072d6aee20e8ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:39.220907 3744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e328470825b4ac783038bbfe56f5248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:39.221017 4040 log.cc:824] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:39.221786 4040 tablet_bootstrap.cc:492] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8: No bootstrap required, opened a new log
I20260811 16:42:39.221872 4040 ts_tablet_manager.cc:1397] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:39.223582 4044 tablet_bootstrap.cc:492] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Bootstrap starting.
I20260811 16:42:39.223688 4042 tablet_bootstrap.cc:492] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: Bootstrap starting.
I20260811 16:42:39.223881 4040 raft_consensus.cc:348] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.224035 4040 raft_consensus.cc:374] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:39.224078 4040 raft_consensus.cc:729] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb1d65b7328446d6b1d0eeff045ad4a8, State: Initialized, Role: FOLLOWER
I20260811 16:42:39.224193 4040 consensus_queue.cc:260] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.224339 4044 tablet_bootstrap.cc:654] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:39.224398 4042 tablet_bootstrap.cc:654] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:39.224479 4040 ts_tablet_manager.cc:1428] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:42:39.224624 3647 heartbeater.cc:503] Master 127.27.186.126:37433 was elected leader, sending a full tablet report...
I20260811 16:42:39.224745 4042 log.cc:824] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:39.225286 4044 log.cc:824] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:39.225608 4042 tablet_bootstrap.cc:492] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: No bootstrap required, opened a new log
I20260811 16:42:39.225693 4042 ts_tablet_manager.cc:1397] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:42:39.226100 4044 tablet_bootstrap.cc:492] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: No bootstrap required, opened a new log
I20260811 16:42:39.226176 4044 ts_tablet_manager.cc:1397] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:42:39.228471 4042 raft_consensus.cc:348] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.228657 4042 raft_consensus.cc:374] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:39.228693 4042 raft_consensus.cc:729] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c1de7f9f1bd42c8a5eee7887f6b4fe2, State: Initialized, Role: FOLLOWER
I20260811 16:42:39.228811 4042 consensus_queue.cc:260] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.229087 4042 ts_tablet_manager.cc:1428] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:42:39.229038 4044 raft_consensus.cc:348] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.229206 4024 heartbeater.cc:503] Master 127.27.186.126:37433 was elected leader, sending a full tablet report...
I20260811 16:42:39.229204 4044 raft_consensus.cc:374] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:39.229243 4044 raft_consensus.cc:729] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501c46d46cb24857a3ff488931a0efc2, State: Initialized, Role: FOLLOWER
I20260811 16:42:39.229359 4044 consensus_queue.cc:260] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.229664 4044 ts_tablet_manager.cc:1428] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 16:42:39.229688 3833 heartbeater.cc:503] Master 127.27.186.126:37433 was elected leader, sending a full tablet report...
W20260811 16:42:39.316298 3834 tablet.cc:2369] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:39.359117 4054 raft_consensus.cc:482] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:39.359248 4054 raft_consensus.cc:504] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.359634 4054 leader_election.cc:288] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c1de7f9f1bd42c8a5eee7887f6b4fe2 (127.27.186.67:41311), bb1d65b7328446d6b1d0eeff045ad4a8 (127.27.186.65:37095)
I20260811 16:42:39.361274 3835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.359837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:41311 (local address 127.27.186.66:52337)
0811 16:42:39.359907 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.359919 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.359964 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.360116 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.360117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.360120 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:39.360688 (+ 568us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:42:39.360689 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:39.360698 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:42:39.360713 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:39.361110 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:39.361111 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:39.361112 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:42:39.361178 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:42:39.361193 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 16:42:39.361292 4036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.359921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:52337 (local address 127.27.186.67:41311)
0811 16:42:39.359993 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.359995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.360006 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:39.360037 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.360038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.360044 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.360109 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.360864 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.360866 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.360866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.360872 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.360897 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.360903 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.360984 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.361209 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.361226 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:42:39.361289 4038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.360036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:33713 (local address 127.27.186.65:37095)
0811 16:42:39.360086 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.360088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.360166 (+ 78us) server_negotiation.cc:407] Connection header received
0811 16:42:39.360198 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.360199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.360205 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.360284 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.361010 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.361011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.361012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.361016 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.361032 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.361036 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.361084 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.361201 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.361217 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:42:39.361307 4055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.359900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:37095 (local address 127.27.186.66:33713)
0811 16:42:39.360088 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.360097 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.360146 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.360290 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.360291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.360307 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:39.360882 (+ 575us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:42:39.360882 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:39.360890 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:42:39.360902 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:39.361103 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:39.361104 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:39.361105 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 16:42:39.361169 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:42:39.361185 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":125,"threads_started":1}
I20260811 16:42:39.361654 3960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e328470825b4ac783038bbfe56f5248" candidate_uuid: "501c46d46cb24857a3ff488931a0efc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" is_pre_election: true
I20260811 16:42:39.361699 3579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e328470825b4ac783038bbfe56f5248" candidate_uuid: "501c46d46cb24857a3ff488931a0efc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" is_pre_election: true
I20260811 16:42:39.361822 3960 raft_consensus.cc:2454] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501c46d46cb24857a3ff488931a0efc2 in term 0.
I20260811 16:42:39.361864 3579 raft_consensus.cc:2454] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 501c46d46cb24857a3ff488931a0efc2 in term 0.
I20260811 16:42:39.362130 3674 leader_election.cc:302] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501c46d46cb24857a3ff488931a0efc2, bb1d65b7328446d6b1d0eeff045ad4a8; no voters:
I20260811 16:42:39.362324 4054 raft_consensus.cc:2781] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:39.362401 4054 raft_consensus.cc:482] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:39.362445 4054 raft_consensus.cc:3037] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:39.363204 4054 raft_consensus.cc:504] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.363359 4054 leader_election.cc:288] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [CANDIDATE]: Term 1 election: Requested vote from peers 5c1de7f9f1bd42c8a5eee7887f6b4fe2 (127.27.186.67:41311), bb1d65b7328446d6b1d0eeff045ad4a8 (127.27.186.65:37095)
I20260811 16:42:39.363509 3579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e328470825b4ac783038bbfe56f5248" candidate_uuid: "501c46d46cb24857a3ff488931a0efc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8"
I20260811 16:42:39.363598 3960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e328470825b4ac783038bbfe56f5248" candidate_uuid: "501c46d46cb24857a3ff488931a0efc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2"
I20260811 16:42:39.363598 3579 raft_consensus.cc:3037] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:39.363672 3960 raft_consensus.cc:3037] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:39.364591 3960 raft_consensus.cc:2454] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501c46d46cb24857a3ff488931a0efc2 in term 1.
I20260811 16:42:39.364591 3579 raft_consensus.cc:2454] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 501c46d46cb24857a3ff488931a0efc2 in term 1.
I20260811 16:42:39.364814 3674 leader_election.cc:302] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501c46d46cb24857a3ff488931a0efc2, bb1d65b7328446d6b1d0eeff045ad4a8; no voters:
I20260811 16:42:39.364941 4054 raft_consensus.cc:2781] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:39.365134 4054 raft_consensus.cc:686] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 1 LEADER]: Becoming Leader. State: Replica: 501c46d46cb24857a3ff488931a0efc2, State: Running, Role: LEADER
I20260811 16:42:39.365247 4054 consensus_queue.cc:237] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } }
I20260811 16:42:39.366214 3364 catalog_manager.cc:5495] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 501c46d46cb24857a3ff488931a0efc2 (127.27.186.66). New cstate: current_term: 1 leader_uuid: "501c46d46cb24857a3ff488931a0efc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "501c46d46cb24857a3ff488931a0efc2" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40545 } health_report { overall_health: HEALTHY } } }
I20260811 16:42:39.397907 4037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.396639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45608 (local address 127.27.186.66:40545)
0811 16:42:39.396723 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.396725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.396735 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:39.396776 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.396777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.396800 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.396860 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.397604 (+ 744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.397605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.397606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.397617 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.397634 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.397638 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.397690 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.397757 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.397803 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 16:42:39.399945 3960 raft_consensus.cc:1261] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 1 FOLLOWER]: Refusing update from remote peer 501c46d46cb24857a3ff488931a0efc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:39.399983 3579 raft_consensus.cc:1261] T 9e328470825b4ac783038bbfe56f5248 P bb1d65b7328446d6b1d0eeff045ad4a8 [term 1 FOLLOWER]: Refusing update from remote peer 501c46d46cb24857a3ff488931a0efc2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:39.400379 4057 consensus_queue.cc:1035] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c1de7f9f1bd42c8a5eee7887f6b4fe2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 41311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:39.400527 4054 consensus_queue.cc:1035] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb1d65b7328446d6b1d0eeff045ad4a8" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 37095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:39.403520 4061 mvcc.cc:205] Tried to move back new op lower bound from 7317367027298852864 to 7317367027160739840. Current Snapshot: MvccSnapshot[applied={T|T < 7317367027298852864}]
I20260811 16:42:39.404255 4063 mvcc.cc:205] Tried to move back new op lower bound from 7317367027298852864 to 7317367027160739840. Current Snapshot: MvccSnapshot[applied={T|T < 7317367027298852864}]
I20260811 16:42:39.404387 4062 mvcc.cc:205] Tried to move back new op lower bound from 7317367027298852864 to 7317367027160739840. Current Snapshot: MvccSnapshot[applied={T|T < 7317367027298852864}]
I20260811 16:42:39.406152 3363 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:39.406268 3363 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:39.407074 3363 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aef7369fcb9d4f69b89cbe3da5ddb116: Sending DeleteTablet for 3 replicas of tablet 9e328470825b4ac783038bbfe56f5248
I20260811 16:42:39.407436 3934 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e328470825b4ac783038bbfe56f5248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:39 UTC) from {username='slave'} at 127.0.0.1:49488
I20260811 16:42:39.407436 3550 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e328470825b4ac783038bbfe56f5248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:39 UTC) from {username='slave'} at 127.0.0.1:37732
I20260811 16:42:39.407517 3744 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e328470825b4ac783038bbfe56f5248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:39 UTC) from {username='slave'} at 127.0.0.1:45594
I20260811 16:42:39.407761 4076 tablet_replica.cc:330] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: stopping tablet replica
I20260811 16:42:39.407799 4077 tablet_replica.cc:330] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: stopping tablet replica
I20260811 16:42:39.407876 4076 raft_consensus.cc:2229] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:39.407876 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 3455
I20260811 16:42:39.411079 4076 raft_consensus.cc:2258] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:39.413030 4077 raft_consensus.cc:2229] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:39.413367 4076 ts_tablet_manager.cc:1905] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:39.415416 4077 raft_consensus.cc:2258] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:39.415772 4076 ts_tablet_manager.cc:1918] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:39.415900 4076 log.cc:1196] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/9e328470825b4ac783038bbfe56f5248
I20260811 16:42:39.416194 4076 ts_tablet_manager.cc:1939] T 9e328470825b4ac783038bbfe56f5248 P 5c1de7f9f1bd42c8a5eee7887f6b4fe2: Deleting consensus metadata
I20260811 16:42:39.416883 4077 ts_tablet_manager.cc:1905] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:39.419230 4077 ts_tablet_manager.cc:1918] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:39.419313 4077 log.cc:1196] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/9e328470825b4ac783038bbfe56f5248
I20260811 16:42:39.419618 4077 ts_tablet_manager.cc:1939] T 9e328470825b4ac783038bbfe56f5248 P 501c46d46cb24857a3ff488931a0efc2: Deleting consensus metadata
I20260811 16:42:39.420850 3342 catalog_manager.cc:4841] TS 501c46d46cb24857a3ff488931a0efc2 (127.27.186.66:40545): tablet 9e328470825b4ac783038bbfe56f5248 (table test-table [id=5da25324fa5a4f2fa7072d6aee20e8ca]) successfully deleted
I20260811 16:42:39.421921 3341 catalog_manager.cc:4841] TS 5c1de7f9f1bd42c8a5eee7887f6b4fe2 (127.27.186.67:41311): tablet 9e328470825b4ac783038bbfe56f5248 (table test-table [id=5da25324fa5a4f2fa7072d6aee20e8ca]) successfully deleted
W20260811 16:42:39.424556 3338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:37095 (error 108)
I20260811 16:42:39.424832 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 3651
I20260811 16:42:39.432467 4034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.424972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:37095 (local address 127.0.0.1:37740)
0811 16:42:39.432345 (+ 7373us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.432420 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:37095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7341}
W20260811 16:42:39.433634 3338 catalog_manager.cc:4584] TS bb1d65b7328446d6b1d0eeff045ad4a8 (127.27.186.65:37095): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9e328470825b4ac783038bbfe56f5248: Network error: Client connection negotiation failed: client connection to 127.27.186.65:37095: connect: Connection refused (error 111)
I20260811 16:42:39.444015 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 3837
I20260811 16:42:39.455565 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 3313
2026-08-11T16:42:39Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (809 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 16:42:39.487412 28393 mini_oidc.cc:152] Starting JWKS server
I20260811 16:42:39.488722 28393 webserver.cc:460] Webserver started at https://127.0.0.1:33845/ using document root <none> and password file <none>
I20260811 16:42:39.488850 28393 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:42:39.489042 28393 webserver.cc:460] Webserver started at http://127.0.0.1:46245/ using document root <none> and password file <none>
2026-08-11T16:42:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:39Z Disabled control of system clock
I20260811 16:42:39.498172 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41819
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:38747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:41819
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33845/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/testchainca.cert with env {}
W20260811 16:42:39.580262 4096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:39.580490 4096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:39.580513 4096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:39.581642 4096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:39.581679 4096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:39.581692 4096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:39.581704 4096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:39.581717 4096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:42:39.581728 4096 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:42:39.581739 4096 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33845/jwks.json
I20260811 16:42:39.583248 4096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:41819
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33845/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:39.583461 4096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:39.583630 4096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:39.589010 4102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:39.589031 4107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:39.589068 4096 server_base.cc:1034] running on GCE node
W20260811 16:42:39.589035 4103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:39.589684 4096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:39.590024 4096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:39.591202 4096 hybrid_clock.cc:648] HybridClock initialized: now 1786466559591185 us; error 47 us; skew 500 ppm
I20260811 16:42:39.592572 4096 webserver.cc:460] Webserver started at http://127.27.186.126:35633/ using document root <none> and password file <none>
I20260811 16:42:39.592805 4096 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:39.592875 4096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:39.593031 4096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:39.594240 4096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "a23216b270354713971a41c54ef43e9d"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "64d3c90a0e2e601025e4808aeb0880a7"
server_key_iv: "ca53487d56782aadba26888615d73c15"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.594650 4096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "a23216b270354713971a41c54ef43e9d"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "64d3c90a0e2e601025e4808aeb0880a7"
server_key_iv: "ca53487d56782aadba26888615d73c15"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.596136 4096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:39.596920 4113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:39.597118 4096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:39.597215 4096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "a23216b270354713971a41c54ef43e9d"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "64d3c90a0e2e601025e4808aeb0880a7"
server_key_iv: "ca53487d56782aadba26888615d73c15"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.597278 4096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:39.607698 4096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:39.607996 4096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:39.608105 4096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:39.612210 4096 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:41819
I20260811 16:42:39.612248 4188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:41819 every 8 connection(s)
I20260811 16:42:39.612636 4096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:39.612813 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 4096
I20260811 16:42:39.612936 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:39.613176 28393 external_mini_cluster.cc:1428] Setting key 4ef9e32024044a3a0fceaaa0c122aa8d
I20260811 16:42:39.613920 4189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:39.617364 4189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d: Bootstrap starting.
I20260811 16:42:39.618225 4189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:39.618558 4189 log.cc:824] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:39.619513 4189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d: No bootstrap required, opened a new log
I20260811 16:42:39.620103 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.613763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41550 (local address 127.27.186.126:41819)
0811 16:42:39.614013 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.614022 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.614058 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:42:39.614699 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.614710 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.614798 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.614967 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.615370 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.616755 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.617732 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.618373 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.618525 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:39.619359 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.619365 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.619365 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.619576 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.619626 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.619642 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.619734 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.619819 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.619916 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260811 16:42:39.621301 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:42:39.621948 4189 raft_consensus.cc:348] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23216b270354713971a41c54ef43e9d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41819 } }
I20260811 16:42:39.622117 4189 raft_consensus.cc:374] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:39.622159 4189 raft_consensus.cc:729] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23216b270354713971a41c54ef43e9d, State: Initialized, Role: FOLLOWER
I20260811 16:42:39.622283 4189 consensus_queue.cc:260] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23216b270354713971a41c54ef43e9d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41819 } }
I20260811 16:42:39.622339 4189 raft_consensus.cc:388] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:39.622360 4189 raft_consensus.cc:482] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:39.622411 4189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:39.623025 4189 raft_consensus.cc:504] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23216b270354713971a41c54ef43e9d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41819 } }
I20260811 16:42:39.623122 4189 leader_election.cc:302] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a23216b270354713971a41c54ef43e9d; no voters:
I20260811 16:42:39.623253 4189 leader_election.cc:288] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:39.623332 4194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:39.623519 4189 sys_catalog.cc:564] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:39.623577 4194 raft_consensus.cc:686] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [term 1 LEADER]: Becoming Leader. State: Replica: a23216b270354713971a41c54ef43e9d, State: Running, Role: LEADER
I20260811 16:42:39.623673 4194 consensus_queue.cc:237] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23216b270354713971a41c54ef43e9d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41819 } }
I20260811 16:42:39.624051 4194 sys_catalog.cc:455] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a23216b270354713971a41c54ef43e9d. Latest consensus state: current_term: 1 leader_uuid: "a23216b270354713971a41c54ef43e9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23216b270354713971a41c54ef43e9d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41819 } } }
I20260811 16:42:39.624133 4194 sys_catalog.cc:458] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:39.624159 4197 sys_catalog.cc:455] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a23216b270354713971a41c54ef43e9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a23216b270354713971a41c54ef43e9d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41819 } } }
I20260811 16:42:39.624260 4197 sys_catalog.cc:458] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:39.624377 4207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:39.624935 4207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:39.626533 4207 catalog_manager.cc:1347] Generated new cluster ID: f8de754863714c1ea308871d8fb5e86b
I20260811 16:42:39.626593 4207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:39.630800 4207 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:39.631304 4207 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:39.636147 4207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a23216b270354713971a41c54ef43e9d: Generated new TSK 0
I20260811 16:42:39.636346 4207 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 16:42:39.667133 4235 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 16:42:39.667341 4235 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 16:42:39.667591 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.645318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41558 (local address 127.27.186.126:41819)
0811 16:42:39.645385 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.645387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.645549 (+ 162us) server_negotiation.cc:407] Connection header received
0811 16:42:39.645688 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.645689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.645703 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.645787 (+ 84us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:42:39.645949 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.646439 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.647277 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.647493 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.647570 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:39.647803 (+ 233us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:42:39.667264 (+ 19461us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 16:42:39.667500 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41558: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 16:42:39.667685 4192 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41558: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 16:42:39.668193 4234 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:39.645220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41819 (local address 127.0.0.1:41558)
0811 16:42:39.645434 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.645444 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.645574 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.645795 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.645796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.645799 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:42:39.645874 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:39.645875 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.646551 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.646553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:39.647182 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:39.647184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.647598 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.647599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:39.647663 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:39.647682 (+ 19us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:42:39.667561 (+ 19879us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 16:42:39.667712 (+ 151us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.186.126:41819: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.27.186.126:41819: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33845/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 16:42:39.668679 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 4096
2026-08-11T16:42:39Z chronyd exiting
I20260811 16:42:39.717303 28393 test_util.cc:175] -----------------------------------------------
I20260811 16:42:39.717409 28393 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786466533930122-28393-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (231 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 16:42:39.718230 28393 mini_oidc.cc:152] Starting JWKS server
I20260811 16:42:39.718936 28393 webserver.cc:460] Webserver started at https://127.0.0.1:40223/ using document root <none> and password file <none>
I20260811 16:42:39.719007 28393 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:42:39.719185 28393 webserver.cc:460] Webserver started at http://127.0.0.1:37019/ using document root <none> and password file <none>
2026-08-11T16:42:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:39Z Disabled control of system clock
I20260811 16:42:39.728420 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:36593
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:39739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:36593
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40223/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/testchainca.cert with env {}
W20260811 16:42:39.814996 4243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:39.815286 4243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:39.815333 4243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:39.816604 4243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:39.816686 4243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:39.816712 4243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:39.816738 4243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:39.816769 4243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:42:39.816804 4243 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:42:39.816833 4243 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40223/jwks.json
I20260811 16:42:39.818536 4243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:39739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:36593
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:36593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40223/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:39.818842 4243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:39.819092 4243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:39.824762 4252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:39.824798 4249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:39.824786 4248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:39.824877 4243 server_base.cc:1034] running on GCE node
I20260811 16:42:39.825359 4243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:39.825704 4243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:39.826884 4243 hybrid_clock.cc:648] HybridClock initialized: now 1786466559826876 us; error 40 us; skew 500 ppm
I20260811 16:42:39.828310 4243 webserver.cc:460] Webserver started at http://127.27.186.126:38255/ using document root <none> and password file <none>
I20260811 16:42:39.828594 4243 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:39.828678 4243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:39.828828 4243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:39.829990 4243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "015df1a75f5b4103a9e27ebf32393661"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "a5bdfb6d50a52b85a0e7c08b8a2a6057"
server_key_iv: "63d7c99c8b8a9913f730d5a76e422022"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.830394 4243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "015df1a75f5b4103a9e27ebf32393661"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "a5bdfb6d50a52b85a0e7c08b8a2a6057"
server_key_iv: "63d7c99c8b8a9913f730d5a76e422022"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.831849 4243 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:39.832670 4262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:39.832866 4243 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:39.832991 4243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "015df1a75f5b4103a9e27ebf32393661"
format_stamp: "Formatted at 2026-08-11 16:42:39 on dist-test-slave-gsp7"
server_key: "a5bdfb6d50a52b85a0e7c08b8a2a6057"
server_key_iv: "63d7c99c8b8a9913f730d5a76e422022"
server_key_version: "encryptionkey@0"
I20260811 16:42:39.833070 4243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:39.852253 4243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:39.852648 4243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:39.852823 4243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:39.857399 4243 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:36593
I20260811 16:42:39.857451 4346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:36593 every 8 connection(s)
I20260811 16:42:39.857901 4243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:39.858650 4347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:39.861418 4347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661: Bootstrap starting.
I20260811 16:42:39.861989 4347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:39.862231 4347 log.cc:824] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:39.862955 4347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661: No bootstrap required, opened a new log
I20260811 16:42:39.864320 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 4243
I20260811 16:42:39.864444 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:39.864629 28393 external_mini_cluster.cc:1428] Setting key 8f97d1477a8f01af8acdeaa1a0004a7d
I20260811 16:42:39.864650 4347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015df1a75f5b4103a9e27ebf32393661" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36593 } }
I20260811 16:42:39.864867 4347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:39.864920 4347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 015df1a75f5b4103a9e27ebf32393661, State: Initialized, Role: FOLLOWER
I20260811 16:42:39.865095 4347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015df1a75f5b4103a9e27ebf32393661" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36593 } }
I20260811 16:42:39.865186 4347 raft_consensus.cc:388] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:39.865226 4347 raft_consensus.cc:482] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:39.865288 4347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:39.865949 4347 raft_consensus.cc:504] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015df1a75f5b4103a9e27ebf32393661" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36593 } }
I20260811 16:42:39.866074 4347 leader_election.cc:302] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 015df1a75f5b4103a9e27ebf32393661; no voters:
I20260811 16:42:39.866237 4347 leader_election.cc:288] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:39.866262 4357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:39.866436 4357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [term 1 LEADER]: Becoming Leader. State: Replica: 015df1a75f5b4103a9e27ebf32393661, State: Running, Role: LEADER
I20260811 16:42:39.866518 4347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:39.866531 4357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015df1a75f5b4103a9e27ebf32393661" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36593 } }
I20260811 16:42:39.867024 4361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 015df1a75f5b4103a9e27ebf32393661. Latest consensus state: current_term: 1 leader_uuid: "015df1a75f5b4103a9e27ebf32393661" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015df1a75f5b4103a9e27ebf32393661" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36593 } } }
I20260811 16:42:39.867169 4361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:39.867378 4360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "015df1a75f5b4103a9e27ebf32393661" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "015df1a75f5b4103a9e27ebf32393661" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36593 } } }
I20260811 16:42:39.867496 4360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:39.867666 4370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:39.868206 4370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:39.869810 4370 catalog_manager.cc:1347] Generated new cluster ID: 19631fd5422b4cb8bd3ea2195eb5c152
I20260811 16:42:39.869872 4370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:39.875310 4370 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:39.875690 4356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.865209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58810 (local address 127.27.186.126:36593)
0811 16:42:39.865414 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.865425 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.865511 (+ 86us) server_negotiation.cc:407] Connection header received
0811 16:42:39.865705 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.865712 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.865775 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.865915 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:39.866202 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.868079 (+ 1877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.869043 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.869687 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.873725 (+ 4038us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:39.874580 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:39.874584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:39.874584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:39.874789 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:39.874828 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:39.874863 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:39.874932 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:39.875198 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 16:42:39.875291 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260811 16:42:39.876049 4370 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:39.876936 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:42:39.893419 4370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 015df1a75f5b4103a9e27ebf32393661: Generated new TSK 0
I20260811 16:42:39.893697 4370 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 16:42:39.917922 4397 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 16:42:39.918032 4397 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 16:42:39.918375 4356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:39.903388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58824 (local address 127.27.186.126:36593)
0811 16:42:39.903456 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:39.903459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:39.903563 (+ 104us) server_negotiation.cc:407] Connection header received
0811 16:42:39.903638 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:39.903639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:39.903652 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:39.903743 (+ 91us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:42:39.903893 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.904699 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.905538 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.905870 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.905944 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:39.906110 (+ 166us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:42:39.918104 (+ 11994us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40223/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 16:42:39.918283 (+ 179us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58824: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40223/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 16:42:39.918447 4356 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58824: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40223/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 16:42:39.918546 4396 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:39.903274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:36593 (local address 127.0.0.1:58824)
0811 16:42:39.903484 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:39.903503 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:39.903566 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:39.903754 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:39.903755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:39.903757 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:42:39.903823 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:39.903825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.904805 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.904806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:39.905419 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:39.905420 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:39.905956 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:39.905957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:39.906003 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:39.906009 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:42:39.918239 (+ 12230us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40223/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 16:42:39.918351 (+ 112us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.186.126:36593: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40223/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":89,"threads_started":1}
I20260811 16:42:39.919220 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 4243
2026-08-11T16:42:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (249 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 16:42:39.968304 28393 mini_oidc.cc:152] Starting JWKS server
I20260811 16:42:39.969033 28393 webserver.cc:460] Webserver started at https://127.0.0.1:36487/ using document root <none> and password file <none>
I20260811 16:42:39.969105 28393 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 16:42:39.969280 28393 webserver.cc:460] Webserver started at http://127.0.0.1:44021/ using document root <none> and password file <none>
2026-08-11T16:42:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:39Z Disabled control of system clock
I20260811 16:42:39.980064 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:42987
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:35893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:42987
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36487/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 16:42:40.065402 4406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:40.065666 4406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:40.065689 4406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:40.066901 4406 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:40.066947 4406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:40.066960 4406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:40.066972 4406 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:40.066987 4406 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:42:40.066998 4406 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:42:40.067009 4406 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36487/jwks.json
I20260811 16:42:40.068424 4406 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:35893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:42987
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:42987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36487/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:40.068712 4406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:40.069082 4406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:40.074283 4412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:40.074299 4411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:40.074667 4406 server_base.cc:1034] running on GCE node
W20260811 16:42:40.074494 4414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:40.075069 4406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:40.075489 4406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:40.076646 4406 hybrid_clock.cc:648] HybridClock initialized: now 1786466560076633 us; error 51 us; skew 500 ppm
I20260811 16:42:40.078048 4406 webserver.cc:460] Webserver started at http://127.27.186.126:34463/ using document root <none> and password file <none>
I20260811 16:42:40.078292 4406 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:40.078365 4406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:40.078528 4406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:40.079643 4406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "48948258a24b4d7b910edf6ff6aab20c"
format_stamp: "Formatted at 2026-08-11 16:42:40 on dist-test-slave-gsp7"
server_key: "5e0d90f09ef2ff81e2ed11ded0ebf952"
server_key_iv: "8493411a9851e85e9c6c1847396ab20b"
server_key_version: "encryptionkey@0"
I20260811 16:42:40.080044 4406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "48948258a24b4d7b910edf6ff6aab20c"
format_stamp: "Formatted at 2026-08-11 16:42:40 on dist-test-slave-gsp7"
server_key: "5e0d90f09ef2ff81e2ed11ded0ebf952"
server_key_iv: "8493411a9851e85e9c6c1847396ab20b"
server_key_version: "encryptionkey@0"
I20260811 16:42:40.081543 4406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:42:40.082340 4427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:40.082541 4406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:40.082645 4406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "48948258a24b4d7b910edf6ff6aab20c"
format_stamp: "Formatted at 2026-08-11 16:42:40 on dist-test-slave-gsp7"
server_key: "5e0d90f09ef2ff81e2ed11ded0ebf952"
server_key_iv: "8493411a9851e85e9c6c1847396ab20b"
server_key_version: "encryptionkey@0"
I20260811 16:42:40.082731 4406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:40.099107 4406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:40.099462 4406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:40.099625 4406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:40.103924 4406 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:42987
I20260811 16:42:40.103971 4510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:42987 every 8 connection(s)
I20260811 16:42:40.104351 4406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:40.105031 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 4406
I20260811 16:42:40.105141 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:40.105142 4512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:40.105333 28393 external_mini_cluster.cc:1428] Setting key 7427badab4d8d5abc8c73bf4fac1d378
I20260811 16:42:40.108960 4512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c: Bootstrap starting.
I20260811 16:42:40.109658 4512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:40.110044 4512 log.cc:824] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:40.110788 4512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c: No bootstrap required, opened a new log
I20260811 16:42:40.111195 4518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:40.105949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37074 (local address 127.27.186.126:42987)
0811 16:42:40.106142 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:40.106149 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:40.106175 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:42:40.106762 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:40.106768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:40.106837 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:40.106948 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:40.107210 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.108061 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.109153 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.109654 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.109781 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:40.110523 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:40.110527 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:40.110528 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:40.110687 (+ 159us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:40.110718 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:40.110729 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:40.110812 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:40.110940 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 16:42:40.111029 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":88,"threads_started":1}
I20260811 16:42:40.112180 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:42:40.113343 4512 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48948258a24b4d7b910edf6ff6aab20c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42987 } }
I20260811 16:42:40.113538 4512 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:40.113588 4512 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48948258a24b4d7b910edf6ff6aab20c, State: Initialized, Role: FOLLOWER
I20260811 16:42:40.113715 4512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48948258a24b4d7b910edf6ff6aab20c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42987 } }
I20260811 16:42:40.113813 4512 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:40.113857 4512 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:40.113907 4512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:40.114512 4512 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48948258a24b4d7b910edf6ff6aab20c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42987 } }
I20260811 16:42:40.114632 4512 leader_election.cc:302] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48948258a24b4d7b910edf6ff6aab20c; no voters:
I20260811 16:42:40.114799 4512 leader_election.cc:288] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:40.114835 4521 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:40.115032 4521 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [term 1 LEADER]: Becoming Leader. State: Replica: 48948258a24b4d7b910edf6ff6aab20c, State: Running, Role: LEADER
I20260811 16:42:40.115067 4512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:40.115125 4521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48948258a24b4d7b910edf6ff6aab20c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42987 } }
I20260811 16:42:40.115474 4522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48948258a24b4d7b910edf6ff6aab20c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48948258a24b4d7b910edf6ff6aab20c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42987 } } }
I20260811 16:42:40.115487 4524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48948258a24b4d7b910edf6ff6aab20c. Latest consensus state: current_term: 1 leader_uuid: "48948258a24b4d7b910edf6ff6aab20c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48948258a24b4d7b910edf6ff6aab20c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42987 } } }
I20260811 16:42:40.115577 4522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:40.115582 4524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:40.115823 4531 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:40.116344 4531 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:40.117915 4531 catalog_manager.cc:1347] Generated new cluster ID: 7e981098db2848708293f92368f7a114
I20260811 16:42:40.117971 4531 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:40.130169 4531 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:40.130884 4531 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:40.142030 4531 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48948258a24b4d7b910edf6ff6aab20c: Generated new TSK 0
I20260811 16:42:40.142288 4531 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:42:40.155763 4518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:40.151493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37084 (local address 127.27.186.126:42987)
0811 16:42:40.151569 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:40.151572 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:40.151699 (+ 127us) server_negotiation.cc:407] Connection header received
0811 16:42:40.151779 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:40.151780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:40.151791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:40.151858 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:42:40.152001 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.152514 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.153700 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.153897 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.153953 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:40.154225 (+ 272us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:42:40.155532 (+ 1307us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 16:42:40.155680 (+ 148us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37084: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 16:42:40.155838 4518 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37084: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 16:42:40.156188 4562 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:40.151427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:42987 (local address 127.0.0.1:37084)
0811 16:42:40.151621 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:40.151633 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:40.151702 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:40.151872 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:40.151873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:40.151875 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:42:40.151935 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:40.151937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.152599 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.152600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:40.153609 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:40.153612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.153981 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.153982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:40.154044 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:40.154050 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:42:40.155955 (+ 1905us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 16:42:40.156069 (+ 114us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.186.126:42987: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36487/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":122,"threads_started":1}
I20260811 16:42:40.156584 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 4406
E20260811 16:42:40.172794 4564 webserver.cc:533] Webserver: sslize failed:
E20260811 16:42:40.172886 4564 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T16:42:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (231 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T16:42:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:40Z Disabled control of system clock
I20260811 16:42:40.209091 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:44453
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:44453
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/testchainca.cert with env {}
W20260811 16:42:40.323983 4570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:40.324267 4570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:40.324312 4570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:40.325726 4570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:40.325796 4570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:40.325820 4570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:40.325856 4570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:40.325902 4570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 16:42:40.325933 4570 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 16:42:40.325964 4570 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 16:42:40.327687 4570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:44453
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:44453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:40.327986 4570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:40.328226 4570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:40.333539 4575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:40.333500 4578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:40.333572 4570 server_base.cc:1034] running on GCE node
W20260811 16:42:40.333499 4576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:40.333998 4570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:40.334342 4570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:40.335542 4570 hybrid_clock.cc:648] HybridClock initialized: now 1786466560335512 us; error 46 us; skew 500 ppm
I20260811 16:42:40.336956 4570 webserver.cc:460] Webserver started at http://127.27.186.126:45021/ using document root <none> and password file <none>
I20260811 16:42:40.337229 4570 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:40.337280 4570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:40.337414 4570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:40.338690 4570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "2c29f70acd314a6fafee0e22bc9f2e74"
format_stamp: "Formatted at 2026-08-11 16:42:40 on dist-test-slave-gsp7"
server_key: "06f2ec95782065665a2a3b9cf523c68e"
server_key_iv: "74b0043a3e4a12a523dc575dd94d95b9"
server_key_version: "encryptionkey@0"
I20260811 16:42:40.339092 4570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "2c29f70acd314a6fafee0e22bc9f2e74"
format_stamp: "Formatted at 2026-08-11 16:42:40 on dist-test-slave-gsp7"
server_key: "06f2ec95782065665a2a3b9cf523c68e"
server_key_iv: "74b0043a3e4a12a523dc575dd94d95b9"
server_key_version: "encryptionkey@0"
I20260811 16:42:40.340607 4570 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:42:40.341593 4586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:40.341780 4570 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:40.341878 4570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "2c29f70acd314a6fafee0e22bc9f2e74"
format_stamp: "Formatted at 2026-08-11 16:42:40 on dist-test-slave-gsp7"
server_key: "06f2ec95782065665a2a3b9cf523c68e"
server_key_iv: "74b0043a3e4a12a523dc575dd94d95b9"
server_key_version: "encryptionkey@0"
I20260811 16:42:40.341945 4570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:40.367364 4570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:40.367659 4570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:40.367772 4570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:40.372030 4570 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:44453
I20260811 16:42:40.372103 4661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:44453 every 8 connection(s)
I20260811 16:42:40.372475 4570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:40.373569 4663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:40.375145 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 4570
I20260811 16:42:40.375228 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:40.375449 28393 external_mini_cluster.cc:1428] Setting key 2cd8c6bf520a4f4c700011b6df09eca4
I20260811 16:42:40.376461 4663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74: Bootstrap starting.
I20260811 16:42:40.377293 4663 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:40.377673 4663 log.cc:824] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:40.378459 4663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74: No bootstrap required, opened a new log
I20260811 16:42:40.380712 4663 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c29f70acd314a6fafee0e22bc9f2e74" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 44453 } }
I20260811 16:42:40.380885 4663 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:40.380940 4663 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c29f70acd314a6fafee0e22bc9f2e74, State: Initialized, Role: FOLLOWER
I20260811 16:42:40.381098 4663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c29f70acd314a6fafee0e22bc9f2e74" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 44453 } }
I20260811 16:42:40.381210 4663 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:40.381249 4663 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:40.381296 4663 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:40.381983 4667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:40.376050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58906 (local address 127.27.186.126:44453)
0811 16:42:40.376295 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:40.376305 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:40.376349 (+ 44us) server_negotiation.cc:407] Connection header received
0811 16:42:40.376954 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:40.376963 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:40.377049 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:40.377232 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:40.377406 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.378765 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.379564 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.380217 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.380393 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:40.381165 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:40.381170 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:40.381170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:42:40.381406 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:40.381450 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:42:40.381466 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:40.381560 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:40.381666 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:42:40.381752 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
I20260811 16:42:40.382117 4663 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c29f70acd314a6fafee0e22bc9f2e74" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 44453 } }
I20260811 16:42:40.382246 4663 leader_election.cc:302] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c29f70acd314a6fafee0e22bc9f2e74; no voters:
I20260811 16:42:40.382427 4663 leader_election.cc:288] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:40.382447 4671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:40.382570 4671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [term 1 LEADER]: Becoming Leader. State: Replica: 2c29f70acd314a6fafee0e22bc9f2e74, State: Running, Role: LEADER
I20260811 16:42:40.382648 4671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c29f70acd314a6fafee0e22bc9f2e74" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 44453 } }
I20260811 16:42:40.382689 4663 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:40.382985 4672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c29f70acd314a6fafee0e22bc9f2e74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c29f70acd314a6fafee0e22bc9f2e74" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 44453 } } }
I20260811 16:42:40.383071 4672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:40.382997 4673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c29f70acd314a6fafee0e22bc9f2e74. Latest consensus state: current_term: 1 leader_uuid: "2c29f70acd314a6fafee0e22bc9f2e74" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c29f70acd314a6fafee0e22bc9f2e74" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 44453 } } }
I20260811 16:42:40.383126 4673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:40.383291 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 16:42:40.384657 4694 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:40.384721 4694 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:40.384802 4677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:40.385035 4677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:40.386752 4677 catalog_manager.cc:1347] Generated new cluster ID: 242e588f57f64786ab2458c39cd82fa0
I20260811 16:42:40.386812 4677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:40.429518 4677 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:40.430158 4677 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:40.439241 4677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c29f70acd314a6fafee0e22bc9f2e74: Generated new TSK 0
I20260811 16:42:40.439450 4677 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:42:41.656153 4667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:40.450262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58920 (local address 127.27.186.126:44453)
0811 16:42:40.450343 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:40.450345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:40.450525 (+ 180us) server_negotiation.cc:407] Connection header received
0811 16:42:40.450559 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:40.450560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:40.450572 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:40.450627 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0811 16:42:40.450796 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.451310 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.452420 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.452636 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.452691 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:40.452900 (+ 209us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 16:42:41.655899 (+1202999us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 16:42:41.656085 (+ 186us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58920: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 16:42:41.656229 4667 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58920: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 16:42:41.656433 4706 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:40.450194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:44453 (local address 127.0.0.1:58920)
0811 16:42:40.450391 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:40.450404 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:40.450481 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:40.450651 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:40.450652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:40.450654 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 16:42:40.450719 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:40.450722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.451427 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.451429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:40.452316 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:40.452320 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:40.452723 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:40.452724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:40.452788 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:40.452794 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 16:42:41.656109 (+1203315us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 16:42:41.656287 (+ 178us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.27.186.126:44453: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":130,"threads_started":1}
I20260811 16:42:41.656836 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 4570
2026-08-11T16:42:41Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1482 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (102 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (95 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:43 dist-test-slave-gsp7 krb5kdc[4723](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:43 dist-test-slave-gsp7 krb5kdc[4723](info): set up 2 sockets
Aug 11 16:42:43 dist-test-slave-gsp7 krb5kdc[4723](info): commencing operation
krb5kdc: starting...
W20260811 16:42:44.422616 28393 mini_kdc.cc:121] Time spent starting KDC: real 2.541s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:44 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:44.561196 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34193
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:34193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:44.645622 4747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:44.645901 4747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:44.645941 4747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:44.647114 4747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:44.647195 4747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:44.647219 4747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:44.647243 4747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:44.647272 4747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:44.648792 4747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:34193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:44.649096 4747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:44.649344 4747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:44.654831 4756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:44.654870 4753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:44.654871 4758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:44.654918 4747 server_base.cc:1034] running on GCE node
I20260811 16:42:44.655478 4747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:44.655843 4747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:44.657022 4747 hybrid_clock.cc:648] HybridClock initialized: now 1786466564657038 us; error 119 us; skew 500 ppm
Aug 11 16:42:44 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466564, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:44.664031 4747 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:44.664595 4747 webserver.cc:460] Webserver started at http://127.27.186.126:32981/ using document root <none> and password file <none>
I20260811 16:42:44.664841 4747 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:44.664912 4747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:44.665076 4747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:44.666353 4747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "3c655e0a18b94ebea4eb063d84d86cbb"
format_stamp: "Formatted at 2026-08-11 16:42:44 on dist-test-slave-gsp7"
server_key: "cf614b50c132ad5c2efe00fb6a5efd1c"
server_key_iv: "237524eb6fb332c0307dedf017bdcd57"
server_key_version: "encryptionkey@0"
I20260811 16:42:44.666807 4747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "3c655e0a18b94ebea4eb063d84d86cbb"
format_stamp: "Formatted at 2026-08-11 16:42:44 on dist-test-slave-gsp7"
server_key: "cf614b50c132ad5c2efe00fb6a5efd1c"
server_key_iv: "237524eb6fb332c0307dedf017bdcd57"
server_key_version: "encryptionkey@0"
I20260811 16:42:44.668309 4747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:42:44.669289 4769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:44.669569 4747 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:44.669703 4747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "3c655e0a18b94ebea4eb063d84d86cbb"
format_stamp: "Formatted at 2026-08-11 16:42:44 on dist-test-slave-gsp7"
server_key: "cf614b50c132ad5c2efe00fb6a5efd1c"
server_key_iv: "237524eb6fb332c0307dedf017bdcd57"
server_key_version: "encryptionkey@0"
I20260811 16:42:44.669796 4747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:44.683450 4747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:44.686098 4747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:44.686296 4747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:44.690968 4747 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:34193
I20260811 16:42:44.691005 4843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:34193 every 8 connection(s)
I20260811 16:42:44.691403 4747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:44.692301 4844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:44.694862 4844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb: Bootstrap starting.
I20260811 16:42:44.695447 4844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:44.695712 4844 log.cc:824] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:44.696609 4844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb: No bootstrap required, opened a new log
I20260811 16:42:44.697445 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 4747
I20260811 16:42:44.697595 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:44.697820 28393 external_mini_cluster.cc:1428] Setting key e54b617aeb18877604d42ad14074d736
I20260811 16:42:44.698971 4844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c655e0a18b94ebea4eb063d84d86cbb" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34193 } }
I20260811 16:42:44.699118 4844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:44.699141 4844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c655e0a18b94ebea4eb063d84d86cbb, State: Initialized, Role: FOLLOWER
I20260811 16:42:44.699339 4844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c655e0a18b94ebea4eb063d84d86cbb" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34193 } }
I20260811 16:42:44.699446 4844 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:44.699481 4844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:44.699535 4844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:44.700740 4844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c655e0a18b94ebea4eb063d84d86cbb" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34193 } }
I20260811 16:42:44.700845 4844 leader_election.cc:302] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c655e0a18b94ebea4eb063d84d86cbb; no voters:
I20260811 16:42:44.701059 4844 leader_election.cc:288] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:44.701086 4852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:44.701208 4852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [term 1 LEADER]: Becoming Leader. State: Replica: 3c655e0a18b94ebea4eb063d84d86cbb, State: Running, Role: LEADER
I20260811 16:42:44.701371 4844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:44.701385 4852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c655e0a18b94ebea4eb063d84d86cbb" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34193 } }
I20260811 16:42:44.701926 4853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c655e0a18b94ebea4eb063d84d86cbb. Latest consensus state: current_term: 1 leader_uuid: "3c655e0a18b94ebea4eb063d84d86cbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c655e0a18b94ebea4eb063d84d86cbb" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34193 } } }
I20260811 16:42:44.702028 4853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:44.702255 4854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c655e0a18b94ebea4eb063d84d86cbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c655e0a18b94ebea4eb063d84d86cbb" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34193 } } }
I20260811 16:42:44.702376 4854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:44.702550 4863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:44.703792 4863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 16:42:44 dist-test-slave-gsp7 krb5kdc[4723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:44.705546 4863 catalog_manager.cc:1347] Generated new cluster ID: ea3b8951a0874321be0a0ecd999e8f17
I20260811 16:42:44.705605 4863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:44.709151 4849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:44.698456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55976 (local address 127.27.186.126:34193)
0811 16:42:44.698642 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:44.698659 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:44.698686 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:42:44.698966 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:44.698975 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:44.699033 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:44.699218 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:44.700123 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:44.701202 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:44.702246 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:44.702893 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:44.703344 (+ 451us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:44.705850 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:44.705854 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:44.705854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:44.705866 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:44.707610 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:44.707993 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:44.707998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:44.707999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:44.708105 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:44.708320 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:44.708321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:44.708321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:44.708559 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:44.708740 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:44.708807 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 16:42:44.708964 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":108,"threads_started":1}
I20260811 16:42:44.724822 4863 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:44.725689 4863 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:44.732573 4863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c655e0a18b94ebea4eb063d84d86cbb: Generated new TSK 0
I20260811 16:42:44.732812 4863 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:44.768714 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34193
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:44.856062 4885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:44.856288 4885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:44.856314 4885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:44.857641 4885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:44.857693 4885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:44.857720 4885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:44.859200 4885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:44.859397 4885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:44.859592 4885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:44.864960 4900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:44.864956 4897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:44.865061 4896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:44.865715 4885 server_base.cc:1034] running on GCE node
I20260811 16:42:44.866010 4885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:44.866313 4885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:44.867494 4885 hybrid_clock.cc:648] HybridClock initialized: now 1786466564867480 us; error 33 us; skew 500 ppm
Aug 11 16:42:44 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466564, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:44.870405 4885 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:44.870931 4885 webserver.cc:460] Webserver started at http://127.27.186.65:36191/ using document root <none> and password file <none>
I20260811 16:42:44.871157 4885 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:44.871201 4885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:44.871295 4885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:44.872455 4885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "5043d83ff264457ca6607ceace2a6440"
format_stamp: "Formatted at 2026-08-11 16:42:44 on dist-test-slave-gsp7"
server_key: "e21b1f3b959609df64084e7ad0384193"
server_key_iv: "5e045a0c21d822628f2b15bce612bd92"
server_key_version: "encryptionkey@0"
I20260811 16:42:44.872884 4885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "5043d83ff264457ca6607ceace2a6440"
format_stamp: "Formatted at 2026-08-11 16:42:44 on dist-test-slave-gsp7"
server_key: "e21b1f3b959609df64084e7ad0384193"
server_key_iv: "5e045a0c21d822628f2b15bce612bd92"
server_key_version: "encryptionkey@0"
I20260811 16:42:44.874634 4885 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 16:42:44.875710 4912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:44.876053 4885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:44.876164 4885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "5043d83ff264457ca6607ceace2a6440"
format_stamp: "Formatted at 2026-08-11 16:42:44 on dist-test-slave-gsp7"
server_key: "e21b1f3b959609df64084e7ad0384193"
server_key_iv: "5e045a0c21d822628f2b15bce612bd92"
server_key_version: "encryptionkey@0"
I20260811 16:42:44.876257 4885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:44.895335 4885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:44.897931 4885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:44.898120 4885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:44.898407 4885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:44.898747 4885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:44.898806 4885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:44.898849 4885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:44.898909 4885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:44.905715 4885 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:43957
I20260811 16:42:44.905768 5091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:43957 every 8 connection(s)
I20260811 16:42:44.906112 4885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:42:44 dist-test-slave-gsp7 krb5kdc[4723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466564, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:44.915570 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 4885
I20260811 16:42:44.915702 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:44.915931 28393 external_mini_cluster.cc:1428] Setting key c8313511bfbc23f54e226450fa126bb9
I20260811 16:42:44.917148 4849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:44.906911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:39735 (local address 127.27.186.126:34193)
0811 16:42:44.906984 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:44.906986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:44.907218 (+ 232us) server_negotiation.cc:407] Connection header received
0811 16:42:44.908248 (+ 1030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:44.908249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:44.908266 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:44.908337 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:44.909048 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:44.909586 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:44.910645 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:44.910876 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:44.910960 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:44.913396 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:44.913398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:44.913398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:44.913409 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:44.915272 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:44.915854 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:44.915855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:44.915855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:44.915918 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:44.916256 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:44.916258 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:44.916258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:44.916469 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:44.916547 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:44.916983 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 16:42:44.917074 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:42:44.917443 5095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:44.906850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34193 (local address 127.27.186.65:39735)
0811 16:42:44.907034 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:44.907080 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:44.908084 (+ 1004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:44.908437 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:44.908441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:44.908735 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:44.908940 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:44.908945 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:44.909675 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:44.909676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:44.910537 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:44.910540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:44.910994 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:44.910995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:44.911101 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:44.911676 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:44.911684 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:44.913240 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:44.915383 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:44.915395 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:44.915398 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:44.915766 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:44.916002 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:44.916003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:44.916003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:44.916171 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:44.916564 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:44.916571 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:44.916786 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 16:42:44.916945 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 16:42:44.917158 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
I20260811 16:42:44.918052 5093 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34193
I20260811 16:42:44.918195 5093 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:44.918433 5093 heartbeater.cc:511] Master 127.27.186.126:34193 requested a full tablet report, sending...
I20260811 16:42:44.919085 4792 ts_manager.cc:194] Registered new tserver with Master: 5043d83ff264457ca6607ceace2a6440 (127.27.186.65:43957)
I20260811 16:42:44.919741 4792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:39735
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:44.945430 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34193
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:45.030285 5099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:45.030512 5099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:45.030536 5099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:45.031756 5099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:45.031810 5099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:45.031837 5099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:45.033438 5099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:45.033721 5099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:45.034008 5099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:45.039525 5112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:45.039547 5107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:45.039831 5099 server_base.cc:1034] running on GCE node
W20260811 16:42:45.039567 5108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:45.040130 5099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:45.040436 5099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:45.041633 5099 hybrid_clock.cc:648] HybridClock initialized: now 1786466565041616 us; error 50 us; skew 500 ppm
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.044742 5099 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:45.045287 5099 webserver.cc:460] Webserver started at http://127.27.186.66:43687/ using document root <none> and password file <none>
I20260811 16:42:45.045627 5099 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:45.045703 5099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:45.045849 5099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:45.047022 5099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "04e7e0750b0e41b3ac8d9cf42b398c2e"
format_stamp: "Formatted at 2026-08-11 16:42:45 on dist-test-slave-gsp7"
server_key: "97011af551b34080e0c66b2bd12b5a96"
server_key_iv: "d92596691f7ad8402c0dbf2bb7a2230d"
server_key_version: "encryptionkey@0"
I20260811 16:42:45.047600 5099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "04e7e0750b0e41b3ac8d9cf42b398c2e"
format_stamp: "Formatted at 2026-08-11 16:42:45 on dist-test-slave-gsp7"
server_key: "97011af551b34080e0c66b2bd12b5a96"
server_key_iv: "d92596691f7ad8402c0dbf2bb7a2230d"
server_key_version: "encryptionkey@0"
I20260811 16:42:45.049371 5099 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 16:42:45.051120 5125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:45.051334 5099 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:45.051534 5099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "04e7e0750b0e41b3ac8d9cf42b398c2e"
format_stamp: "Formatted at 2026-08-11 16:42:45 on dist-test-slave-gsp7"
server_key: "97011af551b34080e0c66b2bd12b5a96"
server_key_iv: "d92596691f7ad8402c0dbf2bb7a2230d"
server_key_version: "encryptionkey@0"
I20260811 16:42:45.051626 5099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:45.066689 5099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:45.068725 5099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:45.068854 5099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:45.069063 5099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:45.069418 5099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:45.069454 5099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:45.069589 5099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:45.069624 5099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:45.076264 5099 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:32815
I20260811 16:42:45.076354 5300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:32815 every 8 connection(s)
I20260811 16:42:45.076690 5099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:45.082028 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 5099
I20260811 16:42:45.082177 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:45.082414 28393 external_mini_cluster.cc:1428] Setting key bd2b30df7b996aaacaec4101fb0170bc
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:45.087352 4849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:45.077552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:51779 (local address 127.27.186.126:34193)
0811 16:42:45.077612 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:45.077615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:45.077822 (+ 207us) server_negotiation.cc:407] Connection header received
0811 16:42:45.078778 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:45.078780 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:45.078790 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:45.078848 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:45.079554 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.080058 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.081107 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.081312 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.081366 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:45.084019 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:45.084021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:45.084021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:45.084030 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:45.085694 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.086215 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.086216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.086216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.086270 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.086576 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.086577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.086578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.086737 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:45.086815 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:45.087104 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 16:42:45.087210 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:42:45.087369 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:45.077519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34193 (local address 127.27.186.66:51779)
0811 16:42:45.077693 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:45.077733 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:45.078681 (+ 948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:45.078906 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:45.078910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:45.079186 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:45.079475 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:45.079480 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.080145 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.080146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:45.081028 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:45.081030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.081391 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.081391 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:45.081562 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:45.082211 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:45.082237 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:45.083925 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:45.085775 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:45.085784 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:45.085787 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:45.086130 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:45.086344 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:45.086345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:45.086346 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:45.086489 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:45.086823 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:45.086830 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:45.086963 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 16:42:45.087056 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 16:42:45.087191 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260811 16:42:45.087972 5301 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34193
I20260811 16:42:45.088114 5301 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:45.088347 5301 heartbeater.cc:511] Master 127.27.186.126:34193 requested a full tablet report, sending...
I20260811 16:42:45.088778 4792 ts_manager.cc:194] Registered new tserver with Master: 04e7e0750b0e41b3ac8d9cf42b398c2e (127.27.186.66:32815)
I20260811 16:42:45.089184 4792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:51779
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:45.113415 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34193
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:45.202539 5311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:45.202840 5311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:45.202880 5311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:45.204116 5311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:45.204185 5311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:45.204231 5311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:45.205853 5311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:45.206128 5311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:45.206374 5311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:45.211707 5322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:45.211714 5324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:45.211732 5321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:45.211823 5311 server_base.cc:1034] running on GCE node
I20260811 16:42:45.212291 5311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:45.212548 5311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:45.213713 5311 hybrid_clock.cc:648] HybridClock initialized: now 1786466565213705 us; error 39 us; skew 500 ppm
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.216398 5311 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:45.216856 5311 webserver.cc:460] Webserver started at http://127.27.186.67:34493/ using document root <none> and password file <none>
I20260811 16:42:45.217092 5311 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:45.217162 5311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:45.217316 5311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:45.218508 5311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "ee76b4e031f440a3a646e8de2d8d3d1a"
format_stamp: "Formatted at 2026-08-11 16:42:45 on dist-test-slave-gsp7"
server_key: "140c1df7ea2e1a50b172f0b7c1536807"
server_key_iv: "6cd1b2f9f2a631ca0283681a9ca6d556"
server_key_version: "encryptionkey@0"
I20260811 16:42:45.218920 5311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "ee76b4e031f440a3a646e8de2d8d3d1a"
format_stamp: "Formatted at 2026-08-11 16:42:45 on dist-test-slave-gsp7"
server_key: "140c1df7ea2e1a50b172f0b7c1536807"
server_key_iv: "6cd1b2f9f2a631ca0283681a9ca6d556"
server_key_version: "encryptionkey@0"
I20260811 16:42:45.220330 5311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:45.221105 5336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:45.221288 5311 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:45.221402 5311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "ee76b4e031f440a3a646e8de2d8d3d1a"
format_stamp: "Formatted at 2026-08-11 16:42:45 on dist-test-slave-gsp7"
server_key: "140c1df7ea2e1a50b172f0b7c1536807"
server_key_iv: "6cd1b2f9f2a631ca0283681a9ca6d556"
server_key_version: "encryptionkey@0"
I20260811 16:42:45.221481 5311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:45.232288 5311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:45.234843 5311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:45.235026 5311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:45.235283 5311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:45.235606 5311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:45.235663 5311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:45.235702 5311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:45.235726 5311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:45.242097 5311 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:43449
I20260811 16:42:45.242143 5520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:43449 every 8 connection(s)
I20260811 16:42:45.242477 5311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:45.249615 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 5311
I20260811 16:42:45.249732 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:45.249933 28393 external_mini_cluster.cc:1428] Setting key 3e2637ddc004307a9b58da9deb79422d
I20260811 16:42:45.252610 4849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:45.243339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:37603 (local address 127.27.186.126:34193)
0811 16:42:45.243430 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:45.243433 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:45.243529 (+ 96us) server_negotiation.cc:407] Connection header received
0811 16:42:45.244574 (+ 1045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:45.244575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:45.244585 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:45.244634 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:45.245316 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.245917 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.247074 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.247249 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.247300 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:45.249720 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:45.249723 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:45.249723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:45.249731 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:45.251342 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.251743 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.251744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.251745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.251796 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.251975 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.251976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.251976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.252082 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:45.252132 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:45.252483 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 16:42:45.252546 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 16:42:45.252874 5525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:45.243203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34193 (local address 127.27.186.67:37603)
0811 16:42:45.243375 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:45.243438 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:45.244476 (+ 1038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:45.244703 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:45.244707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:45.245017 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:45.245234 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:45.245239 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.246032 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.246033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:45.246986 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:45.246990 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.247334 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.247335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:45.247444 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:45.247934 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:45.247944 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:45.249603 (+ 1659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:45.251412 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:45.251419 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:45.251420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:45.251680 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:45.251839 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:45.251839 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:45.251839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:45.251926 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:45.252175 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:45.252183 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:45.252349 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 16:42:45.252460 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 16:42:45.252602 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260811 16:42:45.253338 5521 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34193
I20260811 16:42:45.253441 5521 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:45.253679 5521 heartbeater.cc:511] Master 127.27.186.126:34193 requested a full tablet report, sending...
I20260811 16:42:45.254053 4792 ts_manager.cc:194] Registered new tserver with Master: ee76b4e031f440a3a646e8de2d8d3d1a (127.27.186.67:43449)
I20260811 16:42:45.254448 4792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:37603
I20260811 16:42:45.261969 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/test-admin.keytab.
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.278934 28393 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 16:42:45.280821 5537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:45.279886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41308 (local address 127.27.186.65:43957)
0811 16:42:45.280112 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:45.280117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:45.280128 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:45.280159 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:45.280161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:45.280175 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:45.280247 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:45.280714 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41308: BlockingRecv error: recv got EOF from 127.0.0.1:41308 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":142,"threads_started":1}
W20260811 16:42:45.280830 28393 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5cc' of type FILE
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.281947 28393 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.282940 28393 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:45.291611 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:45.283524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41324 (local address 127.27.186.65:43957)
0811 16:42:45.283580 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:45.283582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:45.283665 (+ 83us) server_negotiation.cc:407] Connection header received
0811 16:42:45.283692 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:45.283693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:45.283705 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:45.283755 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:45.284134 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.284875 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.285652 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.285997 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.286057 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:45.288340 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:45.288350 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:45.288350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:45.288358 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:45.290338 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.290756 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.290759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.290760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.290821 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.291025 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.291026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.291026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.291186 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:45.291309 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:45.291389 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 16:42:45.291459 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 16:42:45.293552 5537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:45.292977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41334 (local address 127.27.186.65:43957)
0811 16:42:45.293042 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:45.293044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:45.293133 (+ 89us) server_negotiation.cc:407] Connection header received
0811 16:42:45.293155 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:45.293156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:45.293166 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:45.293214 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:45.293475 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41334: BlockingRecv error: recv got EOF from 127.0.0.1:41334 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 16:42:45.293689 28393 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5cc)
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.294767 28393 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.295719 28393 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:45.303822 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:45.296347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41348 (local address 127.27.186.65:43957)
0811 16:42:45.296410 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:45.296412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:45.296478 (+ 66us) server_negotiation.cc:407] Connection header received
0811 16:42:45.296553 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:45.296554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:45.296565 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:45.296615 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:45.296988 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.297612 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.298328 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.298556 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.298642 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:45.300933 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:45.300934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:45.300934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:45.300944 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:45.302593 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.302955 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.302957 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.302957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.303027 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.303251 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.303252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.303252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.303364 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:45.303468 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:45.303625 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 16:42:45.303713 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 16:42:45.305827 5537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:45.305088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41364 (local address 127.27.186.65:43957)
0811 16:42:45.305125 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:45.305127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:45.305195 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:42:45.305260 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:45.305261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:45.305269 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:45.305318 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:45.305772 (+ 454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41364: BlockingRecv error: recv got EOF from 127.0.0.1:41364 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 16:42:45.305914 28393 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786466533930122-28393-0/krb5kdc/krb5cc' of type FILE
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.307010 28393 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:45.307935 28393 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[4723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:42:45.315928 5537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:45.308513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41372 (local address 127.27.186.65:43957)
0811 16:42:45.308590 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:45.308592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:45.308667 (+ 75us) server_negotiation.cc:407] Connection header received
0811 16:42:45.308747 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:45.308748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:45.308758 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:45.308828 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:45.309211 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.309777 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.310529 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:45.310743 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:45.310831 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:45.313027 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:45.313028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:45.313028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:45.313037 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:45.314524 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.314964 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.314965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.314966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.315038 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:45.315314 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:45.315315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:45.315315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:45.315449 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:45.315581 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:45.315709 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 16:42:45.315808 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:42:45.316807 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 4885
I20260811 16:42:45.338223 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 5099
I20260811 16:42:45.350988 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 5311
I20260811 16:42:45.370524 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 4747
2026-08-11T16:42:45Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3512 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[5559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[5559](info): set up 2 sockets
Aug 11 16:42:45 dist-test-slave-gsp7 krb5kdc[5559](info): commencing operation
krb5kdc: starting...
W20260811 16:42:46.682881 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:46 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:46Z Disabled control of system clock
WARNING: no policy specified for oryx/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.126.keytab.
Entry for principal oryx/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.126.keytab.
I20260811 16:42:46.820806 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:37797
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.126.keytab
--principal=oryx/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:37797
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:46.906992 5580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:46.907248 5580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:46.907300 5580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:46.908471 5580 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:46.908543 5580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:46.908568 5580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:46.908589 5580 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:46.908619 5580 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:46.910156 5580 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:37797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.126.keytab
--principal=oryx/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:37797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:46.910458 5580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:46.910699 5580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:46.915951 5587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:46.915992 5580 server_base.cc:1034] running on GCE node
W20260811 16:42:46.915936 5593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:46.915961 5588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:46.916493 5580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:46.916795 5580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:46.917959 5580 hybrid_clock.cc:648] HybridClock initialized: now 1786466566917938 us; error 31 us; skew 500 ppm
Aug 11 16:42:46 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466566, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:46.920754 5580 init.cc:377] Logged in from keytab as oryx/127.27.186.126@KRBTEST.COM (short username oryx)
I20260811 16:42:46.921236 5580 webserver.cc:460] Webserver started at http://127.27.186.126:40939/ using document root <none> and password file <none>
I20260811 16:42:46.921548 5580 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:46.921623 5580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:46.921788 5580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:46.922904 5580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "e5c960500c6d47e48f37fd3580254a1e"
format_stamp: "Formatted at 2026-08-11 16:42:46 on dist-test-slave-gsp7"
server_key: "9767b58ddcf8d1d036211900894f9448"
server_key_iv: "bea58e892d45a89905817f8e2fbf5a82"
server_key_version: "encryptionkey@0"
I20260811 16:42:46.923300 5580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "e5c960500c6d47e48f37fd3580254a1e"
format_stamp: "Formatted at 2026-08-11 16:42:46 on dist-test-slave-gsp7"
server_key: "9767b58ddcf8d1d036211900894f9448"
server_key_iv: "bea58e892d45a89905817f8e2fbf5a82"
server_key_version: "encryptionkey@0"
I20260811 16:42:46.924680 5580 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:46.925550 5605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:46.925738 5580 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:46.925850 5580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "e5c960500c6d47e48f37fd3580254a1e"
format_stamp: "Formatted at 2026-08-11 16:42:46 on dist-test-slave-gsp7"
server_key: "9767b58ddcf8d1d036211900894f9448"
server_key_iv: "bea58e892d45a89905817f8e2fbf5a82"
server_key_version: "encryptionkey@0"
I20260811 16:42:46.925949 5580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:46.970280 5580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:46.972815 5580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:46.973006 5580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:46.977229 5580 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:37797
I20260811 16:42:46.977288 5702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:37797 every 8 connection(s)
I20260811 16:42:46.977725 5580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:46.978777 5703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:46.981200 5703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: Bootstrap starting.
I20260811 16:42:46.981786 5703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:46.982052 5703 log.cc:824] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:46.982807 5703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: No bootstrap required, opened a new log
I20260811 16:42:46.984436 5703 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } }
I20260811 16:42:46.984582 5703 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:46.984606 5703 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c960500c6d47e48f37fd3580254a1e, State: Initialized, Role: FOLLOWER
I20260811 16:42:46.984748 5703 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } }
I20260811 16:42:46.984834 5703 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:46.984858 5703 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:46.984886 5703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:46.985760 5703 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } }
I20260811 16:42:46.985853 5703 leader_election.cc:302] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5c960500c6d47e48f37fd3580254a1e; no voters:
I20260811 16:42:46.985997 5703 leader_election.cc:288] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:46.986074 5710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:46.986251 5710 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 1 LEADER]: Becoming Leader. State: Replica: e5c960500c6d47e48f37fd3580254a1e, State: Running, Role: LEADER
I20260811 16:42:46.986274 5703 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:46.986354 5710 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } }
I20260811 16:42:46.986869 5712 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } }
I20260811 16:42:46.986904 5713 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5c960500c6d47e48f37fd3580254a1e. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } }
I20260811 16:42:46.986969 5712 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:46.986990 5713 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:46.987226 5725 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:46.987334 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 5580
I20260811 16:42:46.987464 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:46.987692 28393 external_mini_cluster.cc:1428] Setting key bd4d9fa7f6d2fbfa1c0b332aa365be62
I20260811 16:42:46.987823 5725 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:46.991634 5725 catalog_manager.cc:1347] Generated new cluster ID: 8c1e49ab061e4f4aa84f93217180cd70
I20260811 16:42:46.991700 5725 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:42:46 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:46.998759 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:46.988278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48164 (local address 127.27.186.126:37797)
0811 16:42:46.988509 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:46.988519 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:46.988559 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:42:46.988671 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:46.988677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:46.988720 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:46.988873 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:46.989715 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:46.991120 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:46.992085 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:46.992575 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:46.992739 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:46.995315 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:46.995320 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:46.995320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:46.995332 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:46.997109 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:46.997519 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:46.997523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:46.997523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:46.997638 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:46.997867 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:46.997868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:46.997868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:46.998118 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:46.998313 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:46.998384 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 16:42:46.998537 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260811 16:42:47.001338 5725 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:47.001935 5725 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:47.007746 5725 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: Generated new TSK 0
I20260811 16:42:47.007984 5725 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab.
Entry for principal oryx/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab.
I20260811 16:42:47.045143 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37797
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab
--principal=oryx/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:47.131336 5755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:47.131542 5755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:47.131565 5755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:47.132700 5755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:47.132743 5755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:47.132771 5755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:47.134305 5755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab
--principal=oryx/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:47.134559 5755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:47.134811 5755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:47.139905 5765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.139940 5764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.139912 5767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:47.140391 5755 server_base.cc:1034] running on GCE node
I20260811 16:42:47.140585 5755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:47.140810 5755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:47.142033 5755 hybrid_clock.cc:648] HybridClock initialized: now 1786466567142020 us; error 34 us; skew 500 ppm
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:47.144724 5755 init.cc:377] Logged in from keytab as oryx/127.27.186.65@KRBTEST.COM (short username oryx)
I20260811 16:42:47.145236 5755 webserver.cc:460] Webserver started at http://127.27.186.65:37711/ using document root <none> and password file <none>
I20260811 16:42:47.145579 5755 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:47.145655 5755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:47.145903 5755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:47.147066 5755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "bdeb827bb0514901a2253179bc85e89c"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "69853e88b86b16d2c2ab24f1808066ad"
server_key_iv: "52dc4fe11b087f1f733e5b1e3145b987"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.147472 5755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "bdeb827bb0514901a2253179bc85e89c"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "69853e88b86b16d2c2ab24f1808066ad"
server_key_iv: "52dc4fe11b087f1f733e5b1e3145b987"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.148928 5755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:47.149806 5777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.149984 5755 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:47.150110 5755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "bdeb827bb0514901a2253179bc85e89c"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "69853e88b86b16d2c2ab24f1808066ad"
server_key_iv: "52dc4fe11b087f1f733e5b1e3145b987"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.150190 5755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:47.167955 5755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:47.170660 5755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:47.170855 5755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:47.171139 5755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:47.171517 5755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:47.171576 5755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.171619 5755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:47.171659 5755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.178427 5755 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:33529
I20260811 16:42:47.178476 5967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:33529 every 8 connection(s)
I20260811 16:42:47.178859 5755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:47.181272 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 5755
I20260811 16:42:47.181378 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:47.181618 28393 external_mini_cluster.cc:1428] Setting key 43af14a292413cf8e8810edbaaaa4c87
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:47.190554 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.179713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:52931 (local address 127.27.186.126:37797)
0811 16:42:47.179782 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.179785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.180050 (+ 265us) server_negotiation.cc:407] Connection header received
0811 16:42:47.180548 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.180549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.180564 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.180633 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.181928 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.182583 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.184087 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.184410 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.184497 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.187030 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.187032 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.187032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.187048 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.188968 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.189452 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.189454 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.189454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.189539 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.189803 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.189804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.189804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.189961 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.190052 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.190316 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.190429 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:42:47.190621 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.179693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:52931)
0811 16:42:47.179882 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.179927 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.180457 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.180689 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.180693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.181467 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.181808 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.181815 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.182681 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.182682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.183995 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.183998 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.184512 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.184513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.184621 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.185234 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.185244 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.186918 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.189067 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.189074 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.189075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.189364 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.189616 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.189616 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.189617 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.189724 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.190048 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.190053 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.190177 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.190260 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.190410 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":107,"threads_started":1}
I20260811 16:42:47.191231 5968 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37797
I20260811 16:42:47.191349 5968 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:47.191574 5968 heartbeater.cc:511] Master 127.27.186.126:37797 requested a full tablet report, sending...
I20260811 16:42:47.192215 5630 ts_manager.cc:194] Registered new tserver with Master: bdeb827bb0514901a2253179bc85e89c (127.27.186.65:33529)
WARNING: no policy specified for oryx/127.27.186.66@KRBTEST.COM; defaulting to no policy
I20260811 16:42:47.193004 5630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:52931
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab.
Entry for principal oryx/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab.
I20260811 16:42:47.213656 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37797
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab
--principal=oryx/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:47.299136 5978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:47.299360 5978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:47.299384 5978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:47.300503 5978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:47.300539 5978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:47.300565 5978 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:47.302105 5978 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab
--principal=oryx/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:47.302320 5978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:47.302515 5978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:47.307879 5994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.307880 5986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.307879 5988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:47.308145 5978 server_base.cc:1034] running on GCE node
I20260811 16:42:47.308522 5978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:47.308811 5978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:47.310019 5978 hybrid_clock.cc:648] HybridClock initialized: now 1786466567309985 us; error 54 us; skew 500 ppm
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:47.312994 5978 init.cc:377] Logged in from keytab as oryx/127.27.186.66@KRBTEST.COM (short username oryx)
I20260811 16:42:47.313432 5978 webserver.cc:460] Webserver started at http://127.27.186.66:35467/ using document root <none> and password file <none>
I20260811 16:42:47.313728 5978 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:47.313781 5978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:47.313927 5978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:47.315045 5978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "c124a08eb55d46688c2e3d4789977e47"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "c738ff309060d2b4ca15b8524978f1cb"
server_key_iv: "4799bec41090bbdc7b4e6795ae6fa75c"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.315425 5978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "c124a08eb55d46688c2e3d4789977e47"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "c738ff309060d2b4ca15b8524978f1cb"
server_key_iv: "4799bec41090bbdc7b4e6795ae6fa75c"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.316965 5978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:47.317938 6005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.318151 5978 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:47.318270 5978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "c124a08eb55d46688c2e3d4789977e47"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "c738ff309060d2b4ca15b8524978f1cb"
server_key_iv: "4799bec41090bbdc7b4e6795ae6fa75c"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.318383 5978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:47.332178 5978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:47.334654 5978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:47.334831 5978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:47.335091 5978 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:47.335433 5978 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:47.335489 5978 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.335529 5978 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:47.335572 5978 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.342077 5978 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:39141
I20260811 16:42:47.342216 6206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:39141 every 8 connection(s)
I20260811 16:42:47.342536 5978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:47.349898 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 5978
I20260811 16:42:47.350004 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:47.350247 28393 external_mini_cluster.cc:1428] Setting key ed12d51aba4af89ee03f92786352dbe1
I20260811 16:42:47.353973 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.343468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:56631 (local address 127.27.186.126:37797)
0811 16:42:47.343548 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.343551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.343749 (+ 198us) server_negotiation.cc:407] Connection header received
0811 16:42:47.344380 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.344382 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.344394 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.344465 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.345643 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.346171 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.347327 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.347564 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.347634 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.350278 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.350279 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.350279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.350286 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.352135 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.352569 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.352571 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.352571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.352638 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.353051 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.353052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.353053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.353215 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.353290 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.353760 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.353872 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:42:47.354307 6209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.343382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:56631)
0811 16:42:47.343609 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.343655 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.344225 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.344528 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.344532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.345231 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.345468 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.345529 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.346281 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.346282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.347219 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.347222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.347665 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.347666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.347793 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.348360 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.348370 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.350168 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.352241 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.352248 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.352250 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.352492 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.352767 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.352768 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.352768 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.352970 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.353318 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.353327 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.353588 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.353723 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.353955 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":109,"threads_started":1}
I20260811 16:42:47.354843 6207 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37797
I20260811 16:42:47.354970 6207 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:47.355170 6207 heartbeater.cc:511] Master 127.27.186.126:37797 requested a full tablet report, sending...
I20260811 16:42:47.355610 5630 ts_manager.cc:194] Registered new tserver with Master: c124a08eb55d46688c2e3d4789977e47 (127.27.186.66:39141)
I20260811 16:42:47.355998 5630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:56631
WARNING: no policy specified for oryx/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab.
Entry for principal oryx/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab.
I20260811 16:42:47.382447 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37797
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab
--principal=oryx/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:47.469537 6214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:47.469758 6214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:47.469782 6214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:47.470973 6214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:47.471021 6214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:47.471048 6214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:47.472532 6214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab
--principal=oryx/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:47.472786 6214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:47.473037 6214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:42:47.478482 6214 server_base.cc:1034] running on GCE node
W20260811 16:42:47.478401 6222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.478456 6219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.478415 6220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:47.478825 6214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:47.479099 6214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:47.480294 6214 hybrid_clock.cc:648] HybridClock initialized: now 1786466567480279 us; error 52 us; skew 500 ppm
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:47.483224 6214 init.cc:377] Logged in from keytab as oryx/127.27.186.67@KRBTEST.COM (short username oryx)
I20260811 16:42:47.483677 6214 webserver.cc:460] Webserver started at http://127.27.186.67:36463/ using document root <none> and password file <none>
I20260811 16:42:47.483877 6214 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:47.483927 6214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:47.484025 6214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:47.485139 6214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "5ae3049975694030b6d59d15fa2c5640"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "f50fadfed720be80cb4fec71a933d6df"
server_key_iv: "6bf4adcf4c3dfbc4770eee7ea5e6794c"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.485576 6214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "5ae3049975694030b6d59d15fa2c5640"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "f50fadfed720be80cb4fec71a933d6df"
server_key_iv: "6bf4adcf4c3dfbc4770eee7ea5e6794c"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.487561 6214 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 16:42:47.488471 6231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.488683 6214 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:47.488770 6214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "5ae3049975694030b6d59d15fa2c5640"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "f50fadfed720be80cb4fec71a933d6df"
server_key_iv: "6bf4adcf4c3dfbc4770eee7ea5e6794c"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.488831 6214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:47.500034 6214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:47.502774 6214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:47.502933 6214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:47.503180 6214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:47.503567 6214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:47.503608 6214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.503633 6214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:47.503645 6214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.510531 6214 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:38811
I20260811 16:42:47.510604 6433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:38811 every 8 connection(s)
I20260811 16:42:47.510941 6214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:47.518801 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 6214
I20260811 16:42:47.518903 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:47.519134 28393 external_mini_cluster.cc:1428] Setting key df2587d4fd0a94aae165c65b8319fcf5
I20260811 16:42:47.522504 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.511739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:40163 (local address 127.27.186.126:37797)
0811 16:42:47.511788 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.511790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.512043 (+ 253us) server_negotiation.cc:407] Connection header received
0811 16:42:47.512571 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.512572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.512585 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.512671 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.514168 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.514698 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.515879 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.516075 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.516138 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.519221 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.519223 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.519223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.519233 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.520940 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.521459 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.521461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.521462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.521575 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.521839 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.521840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.521840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.521968 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.522040 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.522354 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.522434 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:42:47.522670 6438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.511703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:40163)
0811 16:42:47.511875 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.511922 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.512452 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.512746 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.512750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.513789 (+ 1039us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.514029 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.514036 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.514817 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.514818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.515778 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.515781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.516189 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.516190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.516312 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.516963 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.516973 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.519049 (+ 2076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.521043 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.521051 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.521054 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.521329 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.521637 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.521637 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.521638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.521755 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.522048 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.522055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.522199 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.522291 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.522445 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260811 16:42:47.523216 6434 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37797
I20260811 16:42:47.523347 6434 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:47.523550 6434 heartbeater.cc:511] Master 127.27.186.126:37797 requested a full tablet report, sending...
I20260811 16:42:47.523998 5630 ts_manager.cc:194] Registered new tserver with Master: 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811)
I20260811 16:42:47.524385 5630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:40163
I20260811 16:42:47.531401 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.27.186.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.125.keytab.
Entry for principal oryx/127.27.186.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.125.keytab.
I20260811 16:42:47.565228 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.125:38531
--webserver_interface=127.27.186.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.125.keytab
--principal=oryx/127.27.186.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:37797,127.27.186.125:38531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:47.655659 6441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:47.655898 6441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:47.655925 6441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:47.657191 6441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:47.657238 6441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:47.657253 6441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:47.657266 6441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:47.657279 6441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:47.659284 6441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:37797,127.27.186.125:38531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.125.keytab
--principal=oryx/127.27.186.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.125:38531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.186.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
W20260811 16:42:47.659606 6441 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.27.186.126:37797,127.27.186.125:38531'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 16:42:47.659799 6441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:47.660043 6441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:47.666433 6452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.666437 6453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.666437 6457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:47.666781 6441 server_base.cc:1034] running on GCE node
I20260811 16:42:47.667048 6441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:47.667380 6441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:47.668560 6441 hybrid_clock.cc:648] HybridClock initialized: now 1786466567668544 us; error 30 us; skew 500 ppm
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:47.671931 6441 init.cc:377] Logged in from keytab as oryx/127.27.186.125@KRBTEST.COM (short username oryx)
I20260811 16:42:47.672463 6441 webserver.cc:460] Webserver started at http://127.27.186.125:37031/ using document root <none> and password file <none>
I20260811 16:42:47.672751 6441 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:47.672830 6441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:47.673019 6441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:47.674593 6441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data/instance:
uuid: "667436fb21bf4f99930d7579be808ec9"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "33d74c445226fdec0a463771b12d6d58"
server_key_iv: "639af6c4f21235502bec76f602d93062"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.675185 6441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal/instance:
uuid: "667436fb21bf4f99930d7579be808ec9"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "33d74c445226fdec0a463771b12d6d58"
server_key_iv: "639af6c4f21235502bec76f602d93062"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.676859 6441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:47.677963 6467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.678272 6441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:47.678406 6441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
uuid: "667436fb21bf4f99930d7579be808ec9"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "33d74c445226fdec0a463771b12d6d58"
server_key_iv: "639af6c4f21235502bec76f602d93062"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.678525 6441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:47.692219 6441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:47.694955 6441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:47.695156 6441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:47.699848 6441 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.125:38531
I20260811 16:42:47.699895 6553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.125:38531 every 8 connection(s)
I20260811 16:42:47.700294 6441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
I20260811 16:42:47.701539 6555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:47.702296 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 6441
I20260811 16:42:47.703979 6555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.125@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.186.125@KRBTEST.COM
I20260811 16:42:47.713809 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.704860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48180 (local address 127.27.186.126:37797)
0811 16:42:47.704956 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.704958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.705186 (+ 228us) server_negotiation.cc:407] Connection header received
0811 16:42:47.705226 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.705227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.705241 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.705310 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.706059 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.706598 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.707651 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.707964 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.708045 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.710551 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.710553 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.710554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.710564 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.712128 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.712648 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.712650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.712650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.712724 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.713014 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.713015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.713015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.713195 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.713276 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.713609 (+ 333us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.713704 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 16:42:47.714056 6560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.704760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48180)
0811 16:42:47.705026 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.705065 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.705137 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.705392 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.705395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.705812 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.705944 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.705951 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.706735 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.706736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.707562 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.707564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.708061 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.708062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.708115 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.708781 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.708789 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.710444 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.712194 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.712202 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.712204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.712522 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.712803 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.712803 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.712804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.712930 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.713278 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.713287 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.713426 (+ 139us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.713573 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.713755 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":160,"threads_started":1}
I20260811 16:42:47.714851 6555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:47.714983 6559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.703298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47816 (local address 127.27.186.125:38531)
0811 16:42:47.703538 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.703555 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.703584 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:42:47.704034 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.704041 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.704246 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.704565 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.705386 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.706584 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.707445 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.707848 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.707926 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.711208 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.711216 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.711217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.711223 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.713140 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.713602 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.713606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.713609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.713672 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.714277 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.714279 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.714279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.714493 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.714673 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.714768 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.714863 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":138,"threads_started":1}
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.125@KRBTEST.COM for oryx/127.27.186.125@KRBTEST.COM
I20260811 16:42:47.722749 6560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.715254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.0.0.1:47822)
0811 16:42:47.715437 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.715459 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.715512 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.715685 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.715686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.715859 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.715919 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.715921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.716579 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.716580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.717210 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.717213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.717693 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.717694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.717766 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.718193 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.718197 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.719470 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.721298 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.721299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.721300 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.721535 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.721757 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.721758 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.721758 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.721824 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.722281 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.722282 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.722346 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.722424 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.722595 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260811 16:42:47.722759 6559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.715297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47822 (local address 127.27.186.125:38531)
0811 16:42:47.715331 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.715333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.715523 (+ 190us) server_negotiation.cc:407] Connection header received
0811 16:42:47.715569 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.715570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.715584 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.715644 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.715995 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.716494 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.717292 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.717575 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.717643 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.719567 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.719568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.719569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.719575 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.721202 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.721608 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.721608 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.721609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.721660 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.721985 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.721987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.721987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.722170 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.722243 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.722502 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.722662 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":15}
I20260811 16:42:47.724660 6555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Bootstrap starting.
I20260811 16:42:47.725692 6555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:47.726032 6555 log.cc:824] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:47.727078 6555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: No bootstrap required, opened a new log
I20260811 16:42:47.728729 6555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } }
I20260811 16:42:47.728991 6555 raft_consensus.cc:374] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:47.729043 6555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 667436fb21bf4f99930d7579be808ec9, State: Initialized, Role: FOLLOWER
I20260811 16:42:47.729233 6555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } }
I20260811 16:42:47.729593 6565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } } }
I20260811 16:42:47.729681 6555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:47.729697 6565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:42:47.731730 6586 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:47.731812 6586 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:47.733560 6441 master_runner.cc:428] Detected that this master 667436fb21bf4f99930d7579be808ec9 is joining an existing cluster
I20260811 16:42:47.733613 6441 master_runner.cc:432] Initiating AddMaster RPC to add 127.27.186.125:38531
I20260811 16:42:47.741645 6559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.735129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47834 (local address 127.27.186.125:38531)
0811 16:42:47.735174 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.735177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.735289 (+ 112us) server_negotiation.cc:407] Connection header received
0811 16:42:47.735375 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.735376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.735384 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.735414 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.736005 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.736518 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.737277 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.737466 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.737575 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.738623 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.738625 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.738625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.738632 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.740405 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.740801 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.740802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.740803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.740866 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.741067 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.741068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.741069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.741184 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.741259 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.741399 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.741529 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":24}
I20260811 16:42:47.742017 6593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.735044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.0.0.1:47834)
0811 16:42:47.735209 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.735220 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.735304 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.735483 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.735483 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.735732 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.735822 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.735824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.736604 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.736606 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.737175 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.737176 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.737629 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.737629 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.737669 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.738181 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.738186 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.738514 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.740505 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.740506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.740506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.740707 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.740933 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.740933 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.740934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.740993 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.741251 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.741252 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.741291 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.741376 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.741618 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":110,"thread_start_us":92,"threads_started":1}
I20260811 16:42:47.742547 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.734808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48192 (local address 127.27.186.126:37797)
0811 16:42:47.734885 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.734887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.735312 (+ 425us) server_negotiation.cc:407] Connection header received
0811 16:42:47.735350 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.735352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.735365 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.735424 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.735950 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.736770 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.738027 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.738333 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.738376 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.739526 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.739528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.739528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.739536 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.741247 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.741719 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.741721 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.741721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.741783 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.741987 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.741988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.741988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.742117 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.742160 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.742359 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.742445 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:42:47.742928 6596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.734729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48192)
0811 16:42:47.735208 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.735221 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.735294 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.735442 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.735443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.735761 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.735837 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.735839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.736995 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.736995 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.737919 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.737922 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.738458 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.738459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.738535 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.738953 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.738958 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.739428 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.741341 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.741342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.741343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.741629 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.741860 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.741860 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.741861 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.741917 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.742208 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.742209 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.742250 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.742671 (+ 421us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.742794 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":116,"threads_started":1}
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466566, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.126@KRBTEST.COM for oryx/127.27.186.125@KRBTEST.COM
I20260811 16:42:47.753386 6559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.745534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47844 (local address 127.27.186.125:38531)
0811 16:42:47.745572 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.745574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.745718 (+ 144us) server_negotiation.cc:407] Connection header received
0811 16:42:47.745804 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.745804 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.745813 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.745857 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.746366 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.746840 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.747959 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.748135 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.748192 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.750547 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.750548 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.750548 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.750556 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.752014 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.752454 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.752456 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.752456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.752518 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.752730 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.752731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.752732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.752847 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.752921 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.753190 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.753281 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:47.753414 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.745401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.0.0.1:47844)
0811 16:42:47.745611 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.745654 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.745729 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.745872 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.745875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.746223 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.746288 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.746290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.746920 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.746921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.747871 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.747874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.748212 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.748213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.748298 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.748735 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.748741 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.750420 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.752127 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.752136 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.752139 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.752360 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.752597 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.752598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.752598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.752667 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.752924 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.752934 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.752991 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.753157 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.753300 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":95,"threads_started":1}
I20260811 16:42:47.754225 5630 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.27.186.125:38531: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "667436fb21bf4f99930d7579be808ec9"
member_type: NON_VOTER
last_known_addr {
host: "127.27.186.125"
port: 38531
}
attrs {
promote: true
}
}
dest_uuid: "e5c960500c6d47e48f37fd3580254a1e"
cas_config_opid_index: -1
I20260811 16:42:47.754665 5630 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } }
I20260811 16:42:47.755203 6600 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 667436fb21bf4f99930d7579be808ec9 (127.27.186.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } }
I20260811 16:42:47.755637 6511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:47.756529 6600 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.27.186.125:38531
I20260811 16:42:47.756721 6511 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Refusing update from remote peer e5c960500c6d47e48f37fd3580254a1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 16:42:47.756902 6441 master.cc:537] Master@127.27.186.125:38531 shutting down...
I20260811 16:42:47.756939 6599 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } }
I20260811 16:42:47.757027 6599 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:47.757150 6599 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 16:42:47.758056 5608 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 16:42:47.758545 5608 consensus_peers.cc:487] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e -> Peer 667436fb21bf4f99930d7579be808ec9 (127.27.186.125:38531): Couldn't send request to peer 667436fb21bf4f99930d7579be808ec9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:42:47.760082 6441 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:47.760180 6441 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:47.760231 6441 tablet_replica.cc:330] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: stopping tablet replica
I20260811 16:42:47.773922 6441 master.cc:552] Master@127.27.186.125:38531 shutdown complete.
I20260811 16:42:47.774003 6441 master_runner.cc:305] Clearing existing system tablet
I20260811 16:42:47.774142 6441 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:47.774209 6441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:47.774964 6441 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:47.775614 6605 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.775794 6441 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:47.775861 6441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:47.775895 6441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
uuid: "667436fb21bf4f99930d7579be808ec9"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "33d74c445226fdec0a463771b12d6d58"
server_key_iv: "639af6c4f21235502bec76f602d93062"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.776686 6441 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:47.778184 6441 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 16:42:47.778257 6441 log.cc:1196] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 16:42:47.778507 6441 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Deleting consensus metadata
I20260811 16:42:47.778646 6441 master_runner.cc:315] Copying system tablet from 127.27.186.126:37797
I20260811 16:42:47.779366 6441 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: tablet copy: Beginning tablet copy session from remote peer at address 127.27.186.126:37797
I20260811 16:42:47.786813 6612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.779781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48196)
0811 16:42:47.779912 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:47.779925 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:47.780000 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:47.780157 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:47.780157 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:47.780368 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:47.780433 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.780436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.781441 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.781442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.782072 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:47.782075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.782586 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.782587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:47.782650 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.783252 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:47.783257 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:47.783626 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:47.785623 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.785624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.785624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.785914 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.786127 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:47.786128 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:47.786128 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:47.786185 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:47.786479 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:47.786480 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:47.786522 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:42:47.786643 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 16:42:47.786737 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":87,"threads_started":1}
I20260811 16:42:47.786891 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.779875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48196 (local address 127.27.186.126:37797)
0811 16:42:47.779930 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.779932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.780004 (+ 72us) server_negotiation.cc:407] Connection header received
0811 16:42:47.780073 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.780074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.780086 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.780153 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.780519 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.781333 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.782160 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.782484 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.782566 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.783725 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.783727 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.783727 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.783735 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.785533 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.785991 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.785992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.785993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.786057 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.786249 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.786251 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.786251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.786414 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.786483 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.786667 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.786756 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:42:47.787524 5673 tablet_copy_service.cc:140] P e5c960500c6d47e48f37fd3580254a1e: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 667436fb21bf4f99930d7579be808ec9 ({username='oryx', principal='oryx/127.27.186.125@KRBTEST.COM'} at 127.0.0.1:48196)
I20260811 16:42:47.787665 5673 tablet_copy_service.cc:161] P e5c960500c6d47e48f37fd3580254a1e: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 667436fb21bf4f99930d7579be808ec9 at {username='oryx', principal='oryx/127.27.186.125@KRBTEST.COM'} at 127.0.0.1:48196: session id = 667436fb21bf4f99930d7579be808ec9-00000000000000000000000000000000
I20260811 16:42:47.788444 5673 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:42:47.789112 6441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 16:42:47.790285 6441 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: tablet copy: Starting download of 0 data blocks...
I20260811 16:42:47.790479 6441 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: tablet copy: Starting download of 1 WAL segments...
I20260811 16:42:47.791636 6441 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:42:47.792609 5673 tablet_copy_service.cc:342] P e5c960500c6d47e48f37fd3580254a1e: Request end of tablet copy session 667436fb21bf4f99930d7579be808ec9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.27.186.125@KRBTEST.COM'} at 127.0.0.1:48196
I20260811 16:42:47.792706 5673 tablet_copy_service.cc:433] P e5c960500c6d47e48f37fd3580254a1e: ending tablet copy session 667436fb21bf4f99930d7579be808ec9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 667436fb21bf4f99930d7579be808ec9
I20260811 16:42:47.795424 6441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:47.796736 6614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.796794 6616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.796774 6613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:47.798532 6441 server_base.cc:1034] running on GCE node
I20260811 16:42:47.798704 6441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:47.798871 6441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:47.800021 6441 hybrid_clock.cc:648] HybridClock initialized: now 1786466567800003 us; error 39 us; skew 500 ppm
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:47.801601 6441 init.cc:377] Logged in from keytab as oryx/127.27.186.125@KRBTEST.COM (short username oryx)
I20260811 16:42:47.801939 6441 webserver.cc:460] Webserver started at http://127.27.186.125:43325/ using document root <none> and password file <none>
I20260811 16:42:47.802093 6441 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:47.802134 6441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:47.802814 6441 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:47.803480 6627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.803634 6441 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:47.803686 6441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
uuid: "667436fb21bf4f99930d7579be808ec9"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "33d74c445226fdec0a463771b12d6d58"
server_key_iv: "639af6c4f21235502bec76f602d93062"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.803754 6441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:47.810343 6441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:47.812183 6441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:47.816452 6441 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.125:38531
I20260811 16:42:47.816944 6441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
I20260811 16:42:47.817085 6715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.125:38531 every 8 connection(s)
I20260811 16:42:47.818069 6716 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:42:47.818696 6716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Bootstrap starting.
I20260811 16:42:47.822098 6716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:42:47.822355 6716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: Bootstrap complete.
I20260811 16:42:47.822608 6716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } }
I20260811 16:42:47.822710 6716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 667436fb21bf4f99930d7579be808ec9, State: Initialized, Role: LEARNER
I20260811 16:42:47.822764 6716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } }
I20260811 16:42:47.823303 6716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:47.823292 6723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } }
I20260811 16:42:47.823520 6723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:42:47.825608 6741 catalog_manager.cc:1259] Loaded cluster ID: 8c1e49ab061e4f4aa84f93217180cd70
I20260811 16:42:47.825701 6741 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: loading cluster ID for follower catalog manager: success
I20260811 16:42:47.826433 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:47.817336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47872 (local address 127.27.186.125:38531)
0811 16:42:47.817595 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:47.817597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:47.817609 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:42:47.817639 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:47.817640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:47.817653 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:47.817746 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:47.818534 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.819528 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.820523 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:47.820830 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:47.820910 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:47.822606 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:47.822607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:47.822607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:47.822615 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:47.824630 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.825129 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.825130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.825131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.825201 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:47.825416 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:47.825417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:47.825417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:47.825585 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:47.825684 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:47.826283 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 16:42:47.826368 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":180,"threads_started":1}
I20260811 16:42:47.827131 6741 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: acquiring CA information for follower catalog manager: success
I20260811 16:42:47.827469 6741 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
WARNING: no policy specified for oryx/127.27.186.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.124.keytab.
Entry for principal oryx/127.27.186.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.124.keytab.
I20260811 16:42:47.857110 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.124:46571
--webserver_interface=127.27.186.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.124.keytab
--principal=oryx/127.27.186.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:37797,127.27.186.125:38531,127.27.186.124:46571
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:47.949033 6746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:47.949326 6746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:47.949357 6746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:47.950832 6746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:47.950899 6746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:47.950918 6746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:47.950935 6746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:47.950950 6746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:47.952842 6746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:37797,127.27.186.125:38531,127.27.186.124:46571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.124.keytab
--principal=oryx/127.27.186.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.124:46571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.186.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:47.953183 6746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:47.953557 6746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:47.959362 6759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.959455 6754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:47.959435 6753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:47.959765 6746 server_base.cc:1034] running on GCE node
I20260811 16:42:47.960059 6746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:47.960460 6746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:47.961648 6746 hybrid_clock.cc:648] HybridClock initialized: now 1786466567961610 us; error 48 us; skew 500 ppm
Aug 11 16:42:47 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:47.965003 6746 init.cc:377] Logged in from keytab as oryx/127.27.186.124@KRBTEST.COM (short username oryx)
I20260811 16:42:47.965739 6746 webserver.cc:460] Webserver started at http://127.27.186.124:36383/ using document root <none> and password file <none>
I20260811 16:42:47.965977 6746 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:47.966029 6746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:47.966143 6746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:47.967391 6746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data/instance:
uuid: "388845614fe244859371ab6470de260f"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "97409638d076bcc85a4ceb72753e9383"
server_key_iv: "c4468bd6bf304202bc2dee94685f3443"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.967819 6746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal/instance:
uuid: "388845614fe244859371ab6470de260f"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "97409638d076bcc85a4ceb72753e9383"
server_key_iv: "c4468bd6bf304202bc2dee94685f3443"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.969594 6746 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260811 16:42:47.970553 6770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:47.970746 6746 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:47.970855 6746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
uuid: "388845614fe244859371ab6470de260f"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "97409638d076bcc85a4ceb72753e9383"
server_key_iv: "c4468bd6bf304202bc2dee94685f3443"
server_key_version: "encryptionkey@0"
I20260811 16:42:47.970918 6746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:47.988088 6746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:47.990928 6746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:47.991094 6746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:47.997206 6746 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.124:46571
I20260811 16:42:47.997258 6846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.124:46571 every 8 connection(s)
I20260811 16:42:47.997773 6746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
I20260811 16:42:47.998842 6847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:48.000592 6847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:48.003893 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 6746
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.124@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.186.124@KRBTEST.COM
I20260811 16:42:48.012064 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.001365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48198)
0811 16:42:48.001705 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.001746 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.002331 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.002575 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.002579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.002836 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.003042 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.003046 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.003852 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.003853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.005082 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.005084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.005527 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.005529 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.005679 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.006229 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.006239 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.008077 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.010118 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.010128 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.010130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.010426 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.010798 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.010800 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.010800 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.010945 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.011347 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.011356 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.011518 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.011682 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.011867 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":266,"threads_started":1}
I20260811 16:42:48.012212 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.001506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48198 (local address 127.27.186.126:37797)
0811 16:42:48.001616 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.001618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.001837 (+ 219us) server_negotiation.cc:407] Connection header received
0811 16:42:48.002444 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.002445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.002457 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.002517 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.003168 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.003684 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.005166 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.005375 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.005463 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.008188 (+ 2725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.008189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.008190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.008198 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.010002 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.010602 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.010604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.010604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.010690 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.011038 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.011040 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.011041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.011214 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.011356 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.012009 (+ 653us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.012112 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 16:42:48.013021 6847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:42:48.014277 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.004596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37688 (local address 127.27.186.124:46571)
0811 16:42:48.004784 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.004789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.004810 (+ 21us) server_negotiation.cc:407] Connection header received
0811 16:42:48.004831 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.004833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.004853 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.004979 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.005591 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.006579 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.007620 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.008017 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.008082 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.010878 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.010888 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.010888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.010904 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.012789 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.013214 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.013217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.013218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.013302 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.013611 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.013612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.013612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.013793 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.014022 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.014080 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.014161 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":106,"threads_started":1}
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.124@KRBTEST.COM for oryx/127.27.186.125@KRBTEST.COM
I20260811 16:42:48.019452 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.013312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.0.0.1:47886)
0811 16:42:48.013367 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.013378 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.013416 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.013683 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.013684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.013806 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.013847 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.013848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.014730 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.014731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.015302 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.015303 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.015705 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.015706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.015775 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.016097 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.016101 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.017218 (+ 1117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.018657 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.018658 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.018658 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.018814 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.018986 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.018986 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.018987 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.019034 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.019234 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.019235 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.019269 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.019319 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.019389 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 16:42:48.019574 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.013431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47886 (local address 127.27.186.125:38531)
0811 16:42:48.013522 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.013524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.013533 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:48.013562 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.013563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.013578 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.013632 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.013942 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.014644 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.015398 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.015616 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.015703 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.017294 (+ 1591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.017296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.017296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.017302 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.018585 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.018877 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.018878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.018878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.018929 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.019087 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.019088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.019088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.019182 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.019231 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.019351 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.019449 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:42:48.019972 6847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466567, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.124@KRBTEST.COM for oryx/127.27.186.124@KRBTEST.COM
I20260811 16:42:48.026167 6849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.020282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:46571 (local address 127.0.0.1:37692)
0811 16:42:48.020317 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.020328 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.020365 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.020474 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.020475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.020581 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.020610 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.020611 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.021288 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.021288 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.021803 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.021805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.022186 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.022186 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.022225 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.022644 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.022648 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.023808 (+ 1160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.025355 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.025356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.025356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.025571 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.025715 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.025715 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.025715 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.025758 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.025932 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.025933 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.025980 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.026032 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.026105 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15}
I20260811 16:42:48.026284 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.020322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37692 (local address 127.27.186.124:46571)
0811 16:42:48.020377 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.020379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.020392 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:42:48.020412 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.020412 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.020420 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.020469 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.020677 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.021219 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.021872 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.022122 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.022187 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.023894 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.023895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.023895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.023901 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.025285 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.025629 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.025630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.025630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.025673 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.025792 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.025792 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.025793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.025874 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.025923 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.026046 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.026150 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":35}
I20260811 16:42:48.027720 6847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Bootstrap starting.
I20260811 16:42:48.028664 6847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:48.029065 6847 log.cc:824] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:48.029961 6847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: No bootstrap required, opened a new log
I20260811 16:42:48.031574 6847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } }
I20260811 16:42:48.031706 6847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:48.031729 6847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388845614fe244859371ab6470de260f, State: Initialized, Role: FOLLOWER
I20260811 16:42:48.031862 6847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } }
I20260811 16:42:48.032181 6853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } } }
I20260811 16:42:48.032225 6847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:48.032298 6853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:42:48.034198 6872 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:48.034281 6872 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:48.036664 6746 master_runner.cc:428] Detected that this master 388845614fe244859371ab6470de260f is joining an existing cluster
I20260811 16:42:48.036727 6746 master_runner.cc:432] Initiating AddMaster RPC to add 127.27.186.124:46571
I20260811 16:42:48.046329 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.038282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48208 (local address 127.27.186.126:37797)
0811 16:42:48.038324 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.038326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.038504 (+ 178us) server_negotiation.cc:407] Connection header received
0811 16:42:48.038560 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.038561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.038575 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.038638 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.039234 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.040004 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.041409 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.041679 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.041768 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.043005 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.043006 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.043006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.043014 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.044822 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.045252 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.045254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.045254 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.045315 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.045651 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.045652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.045652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.045803 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.045900 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.046132 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.046224 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:42:48.046797 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.038278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47892 (local address 127.27.186.125:38531)
0811 16:42:48.038324 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.038326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.038649 (+ 323us) server_negotiation.cc:407] Connection header received
0811 16:42:48.038735 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.038736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.038746 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.038791 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.039189 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.039999 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.042525 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.042827 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.042911 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.044000 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.044002 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.044002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.044011 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.045433 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.045918 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.045920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.045920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.045982 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.046189 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.046190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.046191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.046320 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.046365 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.046609 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.046695 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:42:48.047307 6885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.038027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48208)
0811 16:42:48.038395 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.038414 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.038493 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.038667 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.038669 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.039011 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.039102 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.039104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.040099 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.040100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.041293 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.041296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.041769 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.041770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.041855 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.042389 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.042395 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.042881 (+ 486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.044937 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.044938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.044938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.045160 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.045392 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.045392 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.045393 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.045483 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.045932 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.045933 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.046006 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.046776 (+ 770us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.047145 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":110,"threads_started":1}
I20260811 16:42:48.047314 6886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.038027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.0.0.1:47892)
0811 16:42:48.038593 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.038602 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.038674 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.038794 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.038794 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.039042 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.039102 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.039104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.041443 (+ 2339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.041444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.042421 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.042424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.042931 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.042932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.043033 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.043457 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.043462 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.043897 (+ 435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.045589 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.045590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.045591 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.045828 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.046059 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.046059 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.046060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.046117 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.046436 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.046437 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.046499 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.046927 (+ 428us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.047206 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"mutex_wait_us":187,"thread_start_us":111,"threads_started":1}
I20260811 16:42:48.052407 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.038243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37696 (local address 127.27.186.124:46571)
0811 16:42:48.038281 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.038284 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.045736 (+ 7452us) server_negotiation.cc:407] Connection header received
0811 16:42:48.045787 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.045788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.045799 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.045844 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.046535 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.047267 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.048293 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.048604 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.048648 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.049641 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.049643 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.049643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.049649 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.051231 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.051658 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.051659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.051659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.051720 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.051929 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.051929 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.051930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.052034 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.052086 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.052271 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.052342 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:42:48.052583 6887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.038049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:46571 (local address 127.0.0.1:37696)
0811 16:42:48.045655 (+ 7606us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.045667 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.045730 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.045901 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.045901 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.046088 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.046440 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.046442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.047361 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.047361 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.048190 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.048192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.048718 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.048719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.048776 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.049122 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.049127 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.049564 (+ 437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.051335 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.051336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.051337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.051562 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.051793 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.051794 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.051794 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.051861 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.052099 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.052100 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.052148 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.052256 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.052413 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7561,"mutex_wait_us":48,"thread_start_us":93,"threads_started":1}
I20260811 16:42:48.066092 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 5755
I20260811 16:42:48.086094 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:33529
--local_ip_for_outbound_sockets=127.27.186.65
--tserver_master_addrs=127.27.186.126:37797
--webserver_port=37711
--webserver_interface=127.27.186.65
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab
--principal=oryx/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531,127.27.186.124:46571 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466566, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.126@KRBTEST.COM for oryx/127.27.186.124@KRBTEST.COM
I20260811 16:42:48.090647 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.081153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:46571 (local address 127.0.0.1:37712)
0811 16:42:48.081239 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.081256 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.081331 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.082183 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.082185 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.082409 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.082472 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.082475 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.083468 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.083469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.084352 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.084356 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.084877 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.084879 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.084962 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.085543 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.085549 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.087305 (+ 1756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.089395 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.089396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.089396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.089648 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.089913 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.089914 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.089915 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.089981 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.090279 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.090280 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.090338 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.090421 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.090542 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 16:42:48.090647 6851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.081846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37712 (local address 127.27.186.124:46571)
0811 16:42:48.081963 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.081965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.081975 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:48.082030 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.082031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.082042 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.082109 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.082568 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.083358 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.084482 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.084749 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.084813 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.087442 (+ 2629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.087443 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.087444 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.087452 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.089285 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.089738 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.089739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.089740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.089805 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.090072 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.090073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.090074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.090204 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.090287 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.090452 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.090542 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 16:42:48.091714 5630 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.27.186.124:46571: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "388845614fe244859371ab6470de260f"
member_type: NON_VOTER
last_known_addr {
host: "127.27.186.124"
port: 46571
}
attrs {
promote: true
}
}
dest_uuid: "e5c960500c6d47e48f37fd3580254a1e"
cas_config_opid_index: 5
I20260811 16:42:48.092054 5630 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } }
I20260811 16:42:48.092438 6600 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 388845614fe244859371ab6470de260f (127.27.186.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.093583 6600 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.27.186.124:46571
I20260811 16:42:48.093664 6600 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.093725 6600 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:48.093957 6804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:48.095013 6804 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 FOLLOWER]: Refusing update from remote peer e5c960500c6d47e48f37fd3580254a1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 16:42:48.095489 6599 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:48.095969 6746 master.cc:537] Master@127.27.186.124:46571 shutting down...
I20260811 16:42:48.097306 6804 raft_consensus.cc:858] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } }
W20260811 16:42:48.097404 6804 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } }
I20260811 16:42:48.097959 6804 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 667436fb21bf4f99930d7579be808ec9 (127.27.186.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } }
I20260811 16:42:48.098565 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.092682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47908 (local address 127.27.186.125:38531)
0811 16:42:48.092726 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.092728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.093110 (+ 382us) server_negotiation.cc:407] Connection header received
0811 16:42:48.093215 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.093216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.093245 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.093293 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:48.093566 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.094338 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.097142 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.097975 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.098031 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.098115 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.098434 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.098488 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:42:48.098968 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.092571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.0.0.1:47908)
0811 16:42:48.093005 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.093064 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.093140 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.093386 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.093387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.093389 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:48.093435 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.093437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.094595 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.094596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.096005 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.096009 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.098237 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.098238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.098305 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.098334 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.098817 (+ 483us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.098886 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418}
I20260811 16:42:48.099076 6853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5c960500c6d47e48f37fd3580254a1e. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } }
I20260811 16:42:48.099159 6853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 16:42:48.099200 6853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } }
I20260811 16:42:48.099251 6853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 16:42:48.099282 6853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } }
I20260811 16:42:48.099326 6853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 16:42:48.099459 6665 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 LEARNER]: Refusing update from remote peer e5c960500c6d47e48f37fd3580254a1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 16:42:48.099714 6599 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 16:42:48.100332 6665 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 388845614fe244859371ab6470de260f (127.27.186.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.100942 6889 mvcc.cc:205] Tried to move back new op lower bound from 7317367058461409280 to 7317367058376667136. Current Snapshot: MvccSnapshot[applied={T|T < 7317367058387857408}]
I20260811 16:42:48.102638 6599 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.102751 6599 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
W20260811 16:42:48.103437 5607 consensus_peers.cc:487] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e -> Peer 388845614fe244859371ab6470de260f (127.27.186.124:46571): Couldn't send request to peer 388845614fe244859371ab6470de260f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:42:48.103986 6746 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 16:42:48.103942 6723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5c960500c6d47e48f37fd3580254a1e. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.104064 6723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:42:48.104111 6746 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 16:42:48.104105 6723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: NON_VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: true } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.104149 6723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: This master's current role is: LEARNER
I20260811 16:42:48.104148 6746 tablet_replica.cc:330] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: stopping tablet replica
I20260811 16:42:48.104892 6599 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: attempting to promote NON_VOTER 667436fb21bf4f99930d7579be808ec9 to VOTER
I20260811 16:42:48.105103 6599 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } }
I20260811 16:42:48.105669 6665 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 LEARNER]: Refusing update from remote peer e5c960500c6d47e48f37fd3580254a1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 16:42:48.105886 6898 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260811 16:42:48.106138 5607 consensus_peers.cc:487] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e -> Peer 388845614fe244859371ab6470de260f (127.27.186.124:46571): Couldn't send request to peer 388845614fe244859371ab6470de260f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 16:42:48.106544 6600 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 667436fb21bf4f99930d7579be808ec9 (127.27.186.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.107409 6600 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.107494 6600 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:48.107553 6600 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.107604 6600 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:48.107865 6665 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 667436fb21bf4f99930d7579be808ec9 (127.27.186.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.108808 6900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.108938 6900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:48.123600 6746 master.cc:552] Master@127.27.186.124:46571 shutdown complete.
I20260811 16:42:48.123677 6746 master_runner.cc:305] Clearing existing system tablet
I20260811 16:42:48.123817 6746 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:48.123883 6746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:48.124679 6746 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:48.125240 6903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.125447 6746 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:48.125589 6746 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:48.125630 6746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
uuid: "388845614fe244859371ab6470de260f"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "97409638d076bcc85a4ceb72753e9383"
server_key_iv: "c4468bd6bf304202bc2dee94685f3443"
server_key_version: "encryptionkey@0"
I20260811 16:42:48.126214 6746 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:48.127754 6746 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 16:42:48.127846 6746 log.cc:1196] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 16:42:48.128093 6746 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Deleting consensus metadata
I20260811 16:42:48.128240 6746 master_runner.cc:315] Copying system tablet from 127.27.186.126:37797
I20260811 16:42:48.129292 6746 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: tablet copy: Beginning tablet copy session from remote peer at address 127.27.186.126:37797
I20260811 16:42:48.136772 6913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.130183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48218)
0811 16:42:48.130339 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.130349 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.130419 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.130551 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.130552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.130744 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.130790 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.130792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.131504 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.131506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.132260 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.132262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.132766 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.132768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.132830 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.133400 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.133442 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.133877 (+ 435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.135649 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.135651 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.135651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.135836 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.136057 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.136058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.136058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.136134 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.136412 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.136414 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.136462 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.136544 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.136666 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":86,"threads_started":1}
I20260811 16:42:48.136780 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.130248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.27.186.126:37797)
0811 16:42:48.130308 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.130311 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.130418 (+ 107us) server_negotiation.cc:407] Connection header received
0811 16:42:48.130483 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.130484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.130494 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.130548 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.130880 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.131396 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.132406 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.132674 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.132763 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.133997 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.133999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.133999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.134007 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.135542 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.135915 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.135917 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.135918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.136004 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.136185 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.136186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.136186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.136310 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.136400 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.136622 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.136698 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:42:48.137526 5673 tablet_copy_service.cc:140] P e5c960500c6d47e48f37fd3580254a1e: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 388845614fe244859371ab6470de260f ({username='oryx', principal='oryx/127.27.186.124@KRBTEST.COM'} at 127.0.0.1:48218)
I20260811 16:42:48.137615 5673 tablet_copy_service.cc:161] P e5c960500c6d47e48f37fd3580254a1e: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 388845614fe244859371ab6470de260f at {username='oryx', principal='oryx/127.27.186.124@KRBTEST.COM'} at 127.0.0.1:48218: session id = 388845614fe244859371ab6470de260f-00000000000000000000000000000000
I20260811 16:42:48.138109 5673 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 16:42:48.138609 6746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 16:42:48.139622 6746 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: tablet copy: Starting download of 0 data blocks...
I20260811 16:42:48.139799 6746 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: tablet copy: Starting download of 1 WAL segments...
I20260811 16:42:48.140537 6746 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 16:42:48.141343 5673 tablet_copy_service.cc:342] P e5c960500c6d47e48f37fd3580254a1e: Request end of tablet copy session 388845614fe244859371ab6470de260f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.27.186.124@KRBTEST.COM'} at 127.0.0.1:48218
I20260811 16:42:48.141427 5673 tablet_copy_service.cc:433] P e5c960500c6d47e48f37fd3580254a1e: ending tablet copy session 388845614fe244859371ab6470de260f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 388845614fe244859371ab6470de260f
I20260811 16:42:48.144116 6746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:48.146894 6920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:48.146922 6916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:48.150491 6746 server_base.cc:1034] running on GCE node
W20260811 16:42:48.152876 6917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:48.153052 6746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:48.153282 6746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:48.154443 6746 hybrid_clock.cc:648] HybridClock initialized: now 1786466568154422 us; error 39 us; skew 500 ppm
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:48.156062 6746 init.cc:377] Logged in from keytab as oryx/127.27.186.124@KRBTEST.COM (short username oryx)
I20260811 16:42:48.156378 6746 webserver.cc:460] Webserver started at http://127.27.186.124:37485/ using document root <none> and password file <none>
I20260811 16:42:48.156507 6746 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:48.156545 6746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:48.157204 6746 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:48.157814 6931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.157943 6746 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.157980 6746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
uuid: "388845614fe244859371ab6470de260f"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "97409638d076bcc85a4ceb72753e9383"
server_key_iv: "c4468bd6bf304202bc2dee94685f3443"
server_key_version: "encryptionkey@0"
I20260811 16:42:48.158046 6746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:48.183350 6746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:48.185312 6746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:48.188840 6746 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.124:46571
I20260811 16:42:48.188865 7014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.124:46571 every 8 connection(s)
I20260811 16:42:48.189229 6746 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
I20260811 16:42:48.194245 7016 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:42:48.194702 7016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Bootstrap starting.
I20260811 16:42:48.196668 7016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:42:48.196897 7016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Bootstrap complete.
I20260811 16:42:48.197135 7016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } }
I20260811 16:42:48.197233 7016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 388845614fe244859371ab6470de260f, State: Initialized, Role: LEARNER
I20260811 16:42:48.197283 7016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } }
I20260811 16:42:48.197530 7016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:48.197522 7019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.197746 7019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: LEARNER
I20260811 16:42:48.199985 7040 catalog_manager.cc:1259] Loaded cluster ID: 8c1e49ab061e4f4aa84f93217180cd70
I20260811 16:42:48.200050 7040 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: loading cluster ID for follower catalog manager: success
I20260811 16:42:48.200788 7040 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: acquiring CA information for follower catalog manager: success
I20260811 16:42:48.201061 7040 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 16:42:48.211974 6888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:48.212282 6888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:48.212321 6888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:48.214105 6888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:48.214174 6888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:48.214218 6888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:48.216537 6888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab
--principal=oryx/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:33529
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=37711
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531,127.27.186.124:46571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:48.216804 6888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:48.217070 6888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:48.223299 7047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:48.223327 7046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:48.223299 7049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:48.223760 6888 server_base.cc:1034] running on GCE node
I20260811 16:42:48.223976 6888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:48.224248 6888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:48.225451 6888 hybrid_clock.cc:648] HybridClock initialized: now 1786466568225431 us; error 28 us; skew 500 ppm
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:48.228751 6888 init.cc:377] Logged in from keytab as oryx/127.27.186.65@KRBTEST.COM (short username oryx)
I20260811 16:42:48.229285 6888 webserver.cc:460] Webserver started at http://127.27.186.65:37711/ using document root <none> and password file <none>
I20260811 16:42:48.229609 6888 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:48.229701 6888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:48.231149 6888 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:48.231804 7059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.231988 6888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:48.232088 6888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "bdeb827bb0514901a2253179bc85e89c"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "69853e88b86b16d2c2ab24f1808066ad"
server_key_iv: "52dc4fe11b087f1f733e5b1e3145b987"
server_key_version: "encryptionkey@0"
I20260811 16:42:48.232645 6888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:48.240799 6888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:48.242825 6888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:48.242960 6888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:48.243207 6888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:48.243595 6888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:48.243633 6888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.243657 6888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:48.243670 6888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.250905 6888 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:33529
I20260811 16:42:48.251137 7233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:33529 every 8 connection(s)
I20260811 16:42:48.251398 6888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:48.253724 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 6888
I20260811 16:42:48.253911 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 5978
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.124@KRBTEST.COM
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:48.267417 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.252727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:42073 (local address 127.27.186.124:46571)
0811 16:42:48.252924 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.252926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.252936 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:48.253970 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.253972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.253987 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.254052 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.255060 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.255933 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.257343 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.257664 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.257717 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.261716 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.261718 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.261718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.261727 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.265181 (+ 3454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.266068 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.266070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.266071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.266151 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.266387 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.266388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.266388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.266633 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.266699 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.267215 (+ 516us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.267310 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":131,"threads_started":1}
I20260811 16:42:48.267630 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.252653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:58403 (local address 127.27.186.126:37797)
0811 16:42:48.252851 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.252853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.252868 (+ 15us) server_negotiation.cc:407] Connection header received
0811 16:42:48.254024 (+ 1156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.254026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.254041 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.254074 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.257334 (+ 3260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.258370 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.259631 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.260046 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.260098 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.263660 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.263662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.263662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.263670 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.265501 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.266009 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.266011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.266011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.266067 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.266323 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.266323 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.266324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.266464 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.266512 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.267209 (+ 697us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.267319 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.125@KRBTEST.COM
I20260811 16:42:48.268168 7240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.252266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:46571 (local address 127.27.186.65:42073)
0811 16:42:48.252497 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.252547 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.253768 (+ 1221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.254174 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.254178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.254646 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.254949 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.254955 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.256030 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.256031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.257248 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.257251 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.257788 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.257789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.257945 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.259423 (+ 1478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.259435 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.261606 (+ 2171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.265291 (+ 3685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.265304 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.265307 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.265964 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.266237 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.266238 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.266239 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.266312 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.266735 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.266736 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.266871 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.267006 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.267846 (+ 840us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":125,"threads_started":1}
I20260811 16:42:48.268352 7243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.252266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:58403)
0811 16:42:48.252672 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.252685 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.253784 (+ 1099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.254176 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.254179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.257067 (+ 2888us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.257198 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.257201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.258493 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.258494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.259505 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.259509 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.260193 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.260195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.260281 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.262070 (+ 1789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.262075 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.263560 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.265584 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.265585 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.265585 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.265930 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.266131 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.266131 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.266131 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.266264 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.266572 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.266581 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.267043 (+ 462us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.267874 (+ 831us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.268011 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":4,"thread_start_us":104,"threads_started":1}
I20260811 16:42:48.272112 7234 heartbeater.cc:347] Connected to a master server at 127.27.186.124:46571
I20260811 16:42:48.272112 7236 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37797
I20260811 16:42:48.272248 7234 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.272248 7236 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.272511 7234 heartbeater.cc:511] Master 127.27.186.124:46571 requested a full tablet report, sending...
I20260811 16:42:48.272509 7236 heartbeater.cc:511] Master 127.27.186.126:37797 requested a full tablet report, sending...
I20260811 16:42:48.273039 5630 ts_manager.cc:194] Re-registered known tserver with Master: bdeb827bb0514901a2253179bc85e89c (127.27.186.65:33529)
I20260811 16:42:48.273175 6959 ts_manager.cc:194] Registered new tserver with Master: bdeb827bb0514901a2253179bc85e89c (127.27.186.65:33529)
I20260811 16:42:48.273638 5630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:58403
I20260811 16:42:48.275941 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.252585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:33149 (local address 127.27.186.125:38531)
0811 16:42:48.252918 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.252920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.252930 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:48.253951 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.253953 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.253968 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.254004 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.259637 (+ 5633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.260381 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.261476 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.261872 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.261942 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.272472 (+ 10530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.272474 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.272475 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.272485 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.274499 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.274915 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.274918 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.274918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.274996 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.275244 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.275245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.275245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.275427 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.275495 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.275711 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.275804 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302}
I20260811 16:42:48.276093 7242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.252266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.27.186.65:33149)
0811 16:42:48.252725 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.252735 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.253770 (+ 1035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.259207 (+ 5437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.259208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.259433 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.259489 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.259492 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.260503 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.260504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.261362 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.261365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.266465 (+ 5100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.266466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.266539 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.267016 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.267021 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.272325 (+ 5304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.274610 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.274612 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.274612 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.274815 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.275104 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.275105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.275105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.275168 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.275549 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.275550 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.275592 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.275646 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.275761 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":34,"thread_start_us":110,"threads_started":1}
I20260811 16:42:48.276501 7238 heartbeater.cc:347] Connected to a master server at 127.27.186.125:38531
I20260811 16:42:48.276556 7238 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.276664 7238 heartbeater.cc:511] Master 127.27.186.125:38531 requested a full tablet report, sending...
I20260811 16:42:48.277091 6651 ts_manager.cc:194] Registered new tserver with Master: bdeb827bb0514901a2253179bc85e89c (127.27.186.65:33529)
I20260811 16:42:48.277926 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:39141
--local_ip_for_outbound_sockets=127.27.186.66
--tserver_master_addrs=127.27.186.126:37797
--webserver_port=35467
--webserver_interface=127.27.186.66
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab
--principal=oryx/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531,127.27.186.124:46571 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:48.367679 7247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:48.367944 7247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:48.367988 7247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:48.369186 7247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:48.369270 7247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:48.369323 7247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:48.370939 7247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab
--principal=oryx/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:39141
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=35467
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531,127.27.186.124:46571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:48.371236 7247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:48.371520 7247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:48.377099 7255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:48.377156 7259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:48.377123 7254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:48.377367 7247 server_base.cc:1034] running on GCE node
I20260811 16:42:48.377628 7247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:48.377946 7247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:48.379151 7247 hybrid_clock.cc:648] HybridClock initialized: now 1786466568379124 us; error 37 us; skew 500 ppm
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:48.382040 7247 init.cc:377] Logged in from keytab as oryx/127.27.186.66@KRBTEST.COM (short username oryx)
I20260811 16:42:48.382545 7247 webserver.cc:460] Webserver started at http://127.27.186.66:35467/ using document root <none> and password file <none>
I20260811 16:42:48.382807 7247 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:48.382902 7247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:48.384569 7247 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:48.385238 7266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.385465 7247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:48.385638 7247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "c124a08eb55d46688c2e3d4789977e47"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "c738ff309060d2b4ca15b8524978f1cb"
server_key_iv: "4799bec41090bbdc7b4e6795ae6fa75c"
server_key_version: "encryptionkey@0"
I20260811 16:42:48.386072 7247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:48.398645 7247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:48.401090 7247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:48.401275 7247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:48.401587 7247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:48.401934 7247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:48.401991 7247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.402035 7247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:48.402063 7247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.409260 7247 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:39141
I20260811 16:42:48.409312 7458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:39141 every 8 connection(s)
I20260811 16:42:48.409750 7247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:48.413941 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 7247
I20260811 16:42:48.414109 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 6214
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.124@KRBTEST.COM
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.125@KRBTEST.COM
I20260811 16:42:48.425745 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.410903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:60583 (local address 127.27.186.126:37797)
0811 16:42:48.410977 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.410979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.411370 (+ 391us) server_negotiation.cc:407] Connection header received
0811 16:42:48.412350 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.412351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.412366 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.412405 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.413562 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.414415 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.415936 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.416240 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.416281 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.420780 (+ 4499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.420782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.420783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.420793 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.423163 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.423986 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.423989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.423989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.424066 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.424525 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.424526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.424527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.424727 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.424790 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.425413 (+ 623us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.425569 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:42:48.426563 7472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.410645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:60583)
0811 16:42:48.411293 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.411301 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.412215 (+ 914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.412550 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.412555 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.413117 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.413391 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.413397 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.414564 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.414565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.415832 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.415835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.416368 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.416369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.416514 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.417391 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.417405 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.420630 (+ 3225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.423282 (+ 2652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.423292 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.423296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.423795 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.424169 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.424170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.424171 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.424372 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.424855 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.424865 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.425183 (+ 318us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.425877 (+ 694us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.426166 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":66,"thread_start_us":153,"threads_started":1}
I20260811 16:42:48.427273 7465 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37797
I20260811 16:42:48.427392 7465 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.427621 7465 heartbeater.cc:511] Master 127.27.186.126:37797 requested a full tablet report, sending...
I20260811 16:42:48.428141 5630 ts_manager.cc:194] Re-registered known tserver with Master: c124a08eb55d46688c2e3d4789977e47 (127.27.186.66:39141)
I20260811 16:42:48.428696 5630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:60583
I20260811 16:42:48.428727 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.410827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:55391 (local address 127.27.186.124:46571)
0811 16:42:48.410973 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.410976 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.411226 (+ 250us) server_negotiation.cc:407] Connection header received
0811 16:42:48.412350 (+ 1124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.412351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.412369 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.412405 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.413561 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.414138 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.419914 (+ 5776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.420275 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.420360 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.424497 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.424499 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.424499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.424509 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.427188 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.427658 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.427660 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.427660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.427728 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.428002 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.428004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.428004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.428201 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.428274 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.428514 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.428620 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260811 16:42:48.429128 7470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.410644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:46571 (local address 127.27.186.66:55391)
0811 16:42:48.411160 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.411171 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.412215 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.412550 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.412555 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.413117 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.413391 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.413397 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.419156 (+ 5759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.419158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.419780 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.419782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.420428 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.420430 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.420505 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.421364 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.421370 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.424372 (+ 3002us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.427306 (+ 2934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.427308 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.427308 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.427543 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.427834 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.427835 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.427835 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.427909 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.428318 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.428319 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.428380 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.428837 (+ 457us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.428967 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":8,"thread_start_us":135,"threads_started":1}
I20260811 16:42:48.429699 7464 heartbeater.cc:347] Connected to a master server at 127.27.186.124:46571
I20260811 16:42:48.429754 7464 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.429840 7464 heartbeater.cc:511] Master 127.27.186.124:46571 requested a full tablet report, sending...
I20260811 16:42:48.430259 6959 ts_manager.cc:194] Registered new tserver with Master: c124a08eb55d46688c2e3d4789977e47 (127.27.186.66:39141)
I20260811 16:42:48.430680 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.410986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:47411 (local address 127.27.186.125:38531)
0811 16:42:48.411033 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.411035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.411188 (+ 153us) server_negotiation.cc:407] Connection header received
0811 16:42:48.412317 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.412318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.412335 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.412408 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.416968 (+ 4560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.417730 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.420921 (+ 3191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.421290 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.421346 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.424506 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.424507 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.424507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.424516 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.426785 (+ 2269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.428889 (+ 2104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.428890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.428891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.428965 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.429919 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.429920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.429921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.430134 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.430196 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.430480 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.430570 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:42:48.430701 7471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.410643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.27.186.66:47411)
0811 16:42:48.411065 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.411104 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.412175 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.412550 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.412554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.413155 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.413389 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.413395 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.419933 (+ 6538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.419934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.420790 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.420792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.421450 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.421451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.421554 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.422054 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.422059 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.424341 (+ 2282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.427072 (+ 2731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.427073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.427074 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.427960 (+ 886us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.429062 (+ 1102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.429063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.429063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.429134 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.430297 (+ 1163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.430298 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.430349 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.430432 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.430563 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":122,"threads_started":1}
I20260811 16:42:48.431339 7467 heartbeater.cc:347] Connected to a master server at 127.27.186.125:38531
I20260811 16:42:48.431381 7467 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.431424 7467 heartbeater.cc:511] Master 127.27.186.125:38531 requested a full tablet report, sending...
I20260811 16:42:48.431813 6651 ts_manager.cc:194] Registered new tserver with Master: c124a08eb55d46688c2e3d4789977e47 (127.27.186.66:39141)
I20260811 16:42:48.448709 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:38811
--local_ip_for_outbound_sockets=127.27.186.67
--tserver_master_addrs=127.27.186.126:37797
--webserver_port=36463
--webserver_interface=127.27.186.67
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab
--principal=oryx/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:32779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531,127.27.186.124:46571 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:48.539830 7473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:48.540052 7473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:48.540078 7473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:48.541253 7473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:48.541298 7473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:48.541326 7473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:48.542904 7473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:32779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab
--principal=oryx/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:38811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=36463
--tserver_master_addrs=127.27.186.126:37797,127.27.186.125:38531,127.27.186.124:46571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:48.543161 7473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:48.543428 7473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:48.549115 7481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:48.549145 7482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:48.549259 7473 server_base.cc:1034] running on GCE node
W20260811 16:42:48.549116 7487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:48.549615 7473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:48.549903 7473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:48.551079 7473 hybrid_clock.cc:648] HybridClock initialized: now 1786466568551071 us; error 36 us; skew 500 ppm
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:48.553757 7473 init.cc:377] Logged in from keytab as oryx/127.27.186.67@KRBTEST.COM (short username oryx)
I20260811 16:42:48.554333 7473 webserver.cc:460] Webserver started at http://127.27.186.67:36463/ using document root <none> and password file <none>
I20260811 16:42:48.554577 7473 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:48.554663 7473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:48.556198 7473 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:42:48.556864 7502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.557077 7473 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:48.557186 7473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "5ae3049975694030b6d59d15fa2c5640"
format_stamp: "Formatted at 2026-08-11 16:42:47 on dist-test-slave-gsp7"
server_key: "f50fadfed720be80cb4fec71a933d6df"
server_key_iv: "6bf4adcf4c3dfbc4770eee7ea5e6794c"
server_key_version: "encryptionkey@0"
I20260811 16:42:48.557699 7473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:48.585805 7473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:48.588197 7473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:48.588371 7473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:48.588687 7473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:48.589074 7473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:48.589131 7473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.589176 7473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:48.589203 7473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:48.596020 7473 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:38811
I20260811 16:42:48.596095 7694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:38811 every 8 connection(s)
I20260811 16:42:48.596446 7473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.124@KRBTEST.COM
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
Aug 11 16:42:48 dist-test-slave-gsp7 krb5kdc[5559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466568, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.125@KRBTEST.COM
I20260811 16:42:48.605077 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 7473
I20260811 16:42:48.608292 7707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.597856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:46571 (local address 127.27.186.67:49853)
0811 16:42:48.598041 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.598051 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.598275 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.598565 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.598565 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.599055 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.599301 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.599307 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.600285 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.600285 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.601157 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.601160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.601757 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.601758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.601824 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.602376 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.602381 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.603940 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.606467 (+ 2527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.606474 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.606477 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.606810 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.607046 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.607047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.607048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.607191 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.607525 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.607533 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.607704 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.607821 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.608009 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":7,"thread_start_us":103,"threads_started":1}
I20260811 16:42:48.608793 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.598102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:49853 (local address 127.27.186.124:46571)
0811 16:42:48.598146 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.598148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.598158 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:48.598390 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.598391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.598404 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.598439 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.599416 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.600185 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.601259 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.601614 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.601651 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.604063 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.604065 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.604065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.604072 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.606349 (+ 2277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.606890 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.606892 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.606893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.606960 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.607271 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.607272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.607273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.607431 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.607495 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.608595 (+ 1100us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.608687 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:42:48.608908 7705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.597284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.27.186.67:35931)
0811 16:42:48.597444 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.597519 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.598263 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.598549 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.598555 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.599069 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.599309 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.599311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.600285 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.600285 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.601308 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.601309 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.601807 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.601808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.601882 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.602231 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.602236 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.605278 (+ 3042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.607731 (+ 2453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.607732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.607732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.607975 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.608197 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.608198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.608198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.608260 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.608566 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.608567 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.608616 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.608681 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.608783 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":18,"thread_start_us":87,"threads_started":1}
I20260811 16:42:48.609063 5747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.597273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:36327 (local address 127.27.186.126:37797)
0811 16:42:48.597331 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.597333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.597847 (+ 514us) server_negotiation.cc:407] Connection header received
0811 16:42:48.598397 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.598398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.598411 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.598469 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.599403 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.599925 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.600981 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.601199 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.601274 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.605230 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.605231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.605232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.605242 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.607533 (+ 2291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.607935 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.607937 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.607937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.607998 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.608197 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.608198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.608198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.608330 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.608379 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.608871 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.608958 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:42:48.609170 7697 heartbeater.cc:347] Connected to a master server at 127.27.186.124:46571
I20260811 16:42:48.609277 7697 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.609515 7697 heartbeater.cc:511] Master 127.27.186.124:46571 requested a full tablet report, sending...
I20260811 16:42:48.609694 7706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.597558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:36327)
0811 16:42:48.597749 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.597761 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.598263 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.598914 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.598915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.599097 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:48.599299 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.599304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.600041 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.600042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.600886 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.600888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.601303 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.601304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.601445 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.602111 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:48.602119 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:48.605099 (+ 2980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:48.607614 (+ 2515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.607614 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.607615 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.607850 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.608075 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:48.608076 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:48.608076 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:48.608130 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:48.608687 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:48.608688 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:48.608730 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.609400 (+ 670us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.609538 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":70,"threads_started":1}
I20260811 16:42:48.609743 6721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.597332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:35931 (local address 127.27.186.125:38531)
0811 16:42:48.597409 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.597411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.597606 (+ 195us) server_negotiation.cc:407] Connection header received
0811 16:42:48.598390 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.598391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.598404 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.598439 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.599417 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.600181 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.601374 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.601701 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.601806 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.605400 (+ 3594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.605402 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.605402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.605410 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.607642 (+ 2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.608062 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.608063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.608063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.608124 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.608330 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.608331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.608331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.608467 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.608536 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.609563 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.609644 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:42:48.610100 7701 heartbeater.cc:347] Connected to a master server at 127.27.186.125:38531
I20260811 16:42:48.610152 7701 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.610150 6959 ts_manager.cc:194] Registered new tserver with Master: 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811)
I20260811 16:42:48.610224 7701 heartbeater.cc:511] Master 127.27.186.125:38531 requested a full tablet report, sending...
I20260811 16:42:48.610638 7700 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37797
I20260811 16:42:48.610685 7700 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:48.610760 7700 heartbeater.cc:511] Master 127.27.186.126:37797 requested a full tablet report, sending...
I20260811 16:42:48.610826 6651 ts_manager.cc:194] Registered new tserver with Master: 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811)
I20260811 16:42:48.611017 5630 ts_manager.cc:194] Re-registered known tserver with Master: 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811)
I20260811 16:42:48.611517 5630 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:36327
I20260811 16:42:48.617403 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.606843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47914 (local address 127.27.186.125:38531)
0811 16:42:48.607604 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.607606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.607613 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:42:48.607635 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.607635 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.607647 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.608047 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.608871 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.610137 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.611988 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.612284 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.612341 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.614058 (+ 1717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.614060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.614060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.614068 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.615830 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.616245 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.616247 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.616247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.616311 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.616571 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.616572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.616572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.616723 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.616822 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.617188 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.617281 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":109,"threads_started":1}
I20260811 16:42:48.617656 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.606563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37716 (local address 127.27.186.124:46571)
0811 16:42:48.608876 (+ 2313us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.608878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.609277 (+ 399us) server_negotiation.cc:407] Connection header received
0811 16:42:48.610299 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.610300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.610311 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.610370 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.611116 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.611795 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.612784 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.613082 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.613130 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.614725 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.614727 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.614728 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.614735 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.616446 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.616835 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.616837 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.616837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.616901 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.617112 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.617113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.617113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.617234 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.617339 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.617448 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.617555 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2298,"thread_start_us":62,"threads_started":1}
I20260811 16:42:48.618396 7721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.607125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48226 (local address 127.27.186.126:37797)
0811 16:42:48.607380 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.607382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.609428 (+ 2046us) server_negotiation.cc:407] Connection header received
0811 16:42:48.609466 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.609467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.609506 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.609580 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.610948 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.611751 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.612726 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.613059 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.613128 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.614670 (+ 1542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.614672 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.614673 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.614680 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.616640 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.617006 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.617007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.617007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.617069 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.617349 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.617350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.617350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.617637 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.617731 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.618235 (+ 504us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.618330 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":60,"threads_started":1}
I20260811 16:42:48.620152 5630 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48226:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:48.621862 5630 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:48.630407 7731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.625832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:39141 (local address 127.0.0.1:47262)
0811 16:42:48.626235 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.626245 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.626286 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.626706 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.626707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.626709 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:48.626755 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.626757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.628129 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.628130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.629348 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.629351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.630145 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.630146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.630211 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.630216 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.630269 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.630313 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":2,"thread_start_us":54,"threads_started":1}
I20260811 16:42:48.630532 7733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.625831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38811 (local address 127.0.0.1:36862)
0811 16:42:48.626131 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.626144 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.626203 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.627270 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.627271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.627274 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:48.627329 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.627330 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.628568 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.628570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.629376 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.629379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.630264 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.630265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.630319 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.630322 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.630363 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.630430 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":95,"threads_started":1}
I20260811 16:42:48.630656 7732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.625857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:33529 (local address 127.0.0.1:51736)
0811 16:42:48.626779 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.626814 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.626876 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.627063 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.627064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.627067 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:48.627117 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.627119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.627952 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.627954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.629164 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.629167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.630370 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.630371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.630435 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.630440 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.630503 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.630556 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":899,"thread_start_us":223,"threads_started":1}
I20260811 16:42:48.630820 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.626046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47262 (local address 127.27.186.66:39141)
0811 16:42:48.626555 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.626559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.626567 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:48.626604 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.626606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.626620 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.626694 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:48.626842 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.628012 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.629417 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.629997 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.630120 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.630208 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.630653 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.630734 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":103,"threads_started":1}
I20260811 16:42:48.631004 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.625966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51736 (local address 127.27.186.65:33529)
0811 16:42:48.626443 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.626459 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.626871 (+ 412us) server_negotiation.cc:407] Connection header received
0811 16:42:48.626955 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.626957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.626970 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.627067 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:48.627175 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.627851 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.629260 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.630089 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.630166 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.630326 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.630834 (+ 508us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.630895 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":82,"threads_started":1}
I20260811 16:42:48.631275 7739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.626165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36862 (local address 127.27.186.67:38811)
0811 16:42:48.627042 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.627047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.627056 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:48.627094 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.627096 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.627112 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.627193 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:48.627403 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.628482 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.629500 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.630201 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.630262 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.630341 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.630375 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.630419 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":832,"thread_start_us":88,"threads_started":1}
I20260811 16:42:48.631542 7351 tablet_service.cc:1467] Processing CreateTablet for tablet 020071354a0e47788ee86f4e16fbce89 (DEFAULT_TABLE table=test-table [id=1e8a94b91c6447d48153529badda3f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:48.631655 7136 tablet_service.cc:1467] Processing CreateTablet for tablet 020071354a0e47788ee86f4e16fbce89 (DEFAULT_TABLE table=test-table [id=1e8a94b91c6447d48153529badda3f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:48.631824 7585 tablet_service.cc:1467] Processing CreateTablet for tablet 020071354a0e47788ee86f4e16fbce89 (DEFAULT_TABLE table=test-table [id=1e8a94b91c6447d48153529badda3f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:48.631958 7351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 020071354a0e47788ee86f4e16fbce89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:48.632033 7136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 020071354a0e47788ee86f4e16fbce89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:48.632146 7585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 020071354a0e47788ee86f4e16fbce89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:48.635048 7740 tablet_bootstrap.cc:492] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Bootstrap starting.
I20260811 16:42:48.635797 7740 tablet_bootstrap.cc:654] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:48.635906 7743 tablet_bootstrap.cc:492] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: Bootstrap starting.
I20260811 16:42:48.636320 7740 log.cc:824] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:48.636662 7743 tablet_bootstrap.cc:654] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:48.637008 7743 log.cc:824] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:48.637228 7740 tablet_bootstrap.cc:492] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: No bootstrap required, opened a new log
I20260811 16:42:48.637303 7740 ts_tablet_manager.cc:1397] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:42:48.637362 7745 tablet_bootstrap.cc:492] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: Bootstrap starting.
I20260811 16:42:48.637830 7743 tablet_bootstrap.cc:492] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: No bootstrap required, opened a new log
I20260811 16:42:48.637916 7743 ts_tablet_manager.cc:1397] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:48.638126 7745 tablet_bootstrap.cc:654] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:48.638468 7745 log.cc:824] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:48.639410 7745 tablet_bootstrap.cc:492] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: No bootstrap required, opened a new log
I20260811 16:42:48.639483 7745 ts_tablet_manager.cc:1397] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 16:42:48.640390 7743 raft_consensus.cc:348] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.640334 7740 raft_consensus.cc:348] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.640563 7743 raft_consensus.cc:374] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:48.640573 7740 raft_consensus.cc:374] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:48.640610 7740 raft_consensus.cc:729] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c124a08eb55d46688c2e3d4789977e47, State: Initialized, Role: FOLLOWER
I20260811 16:42:48.640609 7743 raft_consensus.cc:729] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ae3049975694030b6d59d15fa2c5640, State: Initialized, Role: FOLLOWER
I20260811 16:42:48.640751 7743 consensus_queue.cc:260] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.640756 7740 consensus_queue.cc:260] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.641129 7743 ts_tablet_manager.cc:1428] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:42:48.641140 7740 ts_tablet_manager.cc:1428] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 16:42:48.641239 7465 heartbeater.cc:503] Master 127.27.186.126:37797 was elected leader, sending a full tablet report...
I20260811 16:42:48.642192 7700 heartbeater.cc:503] Master 127.27.186.126:37797 was elected leader, sending a full tablet report...
I20260811 16:42:48.644531 7745 raft_consensus.cc:348] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.644663 7745 raft_consensus.cc:374] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:48.644685 7745 raft_consensus.cc:729] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdeb827bb0514901a2253179bc85e89c, State: Initialized, Role: FOLLOWER
I20260811 16:42:48.644807 7745 consensus_queue.cc:260] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.645129 7745 ts_tablet_manager.cc:1428] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260811 16:42:48.645263 7236 heartbeater.cc:503] Master 127.27.186.126:37797 was elected leader, sending a full tablet report...
W20260811 16:42:48.662781 7468 tablet.cc:2369] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:48.666298 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.663476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37732 (local address 127.27.186.124:46571)
0811 16:42:48.663542 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.663545 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.663555 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:48.663583 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.663584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.663620 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.663682 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:48.663886 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.664393 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.665419 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.665995 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.666057 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.666115 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.666214 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.666243 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:42:48.666299 7731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.663334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:46571 (local address 127.0.0.1:37732)
0811 16:42:48.663411 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.663425 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.663491 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.663711 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.663712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.663715 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:48.663794 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.663797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.664491 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.664492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.665334 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.665336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.666081 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.666082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.666143 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.666146 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.666197 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.666239 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 16:42:48.666749 6978 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 16:42:48.667217 7019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5c960500c6d47e48f37fd3580254a1e. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.667341 7019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: LEARNER
I20260811 16:42:48.669189 7756 raft_consensus.cc:482] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:48.669286 7756 raft_consensus.cc:504] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.669606 7756 leader_election.cc:288] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811), c124a08eb55d46688c2e3d4789977e47 (127.27.186.66:39141)
I20260811 16:42:48.672811 7739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.669964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:59989 (local address 127.27.186.67:38811)
0811 16:42:48.670036 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.670038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.670045 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:42:48.670089 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.670090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.670101 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.670167 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:48.670483 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.670963 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.672011 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.672389 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.672446 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.672460 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.672681 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.672737 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:42:48.672822 7242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.669792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38811 (local address 127.27.186.65:59989)
0811 16:42:48.669853 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.669880 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.669936 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.670198 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.670199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.670200 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:48.670390 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.670393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.671053 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.671054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.671911 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.671914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.672476 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.672477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.672602 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.672607 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.672664 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.672698 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":35}
I20260811 16:42:48.672875 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.669874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:45439 (local address 127.27.186.66:39141)
0811 16:42:48.669929 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.669931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.670096 (+ 165us) server_negotiation.cc:407] Connection header received
0811 16:42:48.670126 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.670128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.670137 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.670193 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:48.670498 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.671036 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.672026 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.672495 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.672584 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.672594 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.672754 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.672803 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:42:48.673058 7243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.669841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:39141 (local address 127.27.186.65:45439)
0811 16:42:48.670025 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:48.670034 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:48.670076 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:48.670210 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:48.670211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:48.670212 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:48.670409 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.670410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.671124 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.671125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.671914 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:48.671917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.672580 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.672581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:48.672664 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.672668 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:48.672726 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 16:42:48.672762 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":25}
I20260811 16:42:48.673432 7388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "020071354a0e47788ee86f4e16fbce89" candidate_uuid: "bdeb827bb0514901a2253179bc85e89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c124a08eb55d46688c2e3d4789977e47" is_pre_election: true
I20260811 16:42:48.673647 7388 raft_consensus.cc:2454] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdeb827bb0514901a2253179bc85e89c in term 0.
I20260811 16:42:48.673759 7620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "020071354a0e47788ee86f4e16fbce89" candidate_uuid: "bdeb827bb0514901a2253179bc85e89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ae3049975694030b6d59d15fa2c5640" is_pre_election: true
I20260811 16:42:48.673945 7620 raft_consensus.cc:2454] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdeb827bb0514901a2253179bc85e89c in term 0.
I20260811 16:42:48.673983 7061 leader_election.cc:302] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdeb827bb0514901a2253179bc85e89c, c124a08eb55d46688c2e3d4789977e47; no voters:
I20260811 16:42:48.674166 7756 raft_consensus.cc:2781] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:48.674232 7756 raft_consensus.cc:482] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:48.674269 7756 raft_consensus.cc:3037] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:48.675176 7756 raft_consensus.cc:504] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.675340 7756 leader_election.cc:288] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [CANDIDATE]: Term 1 election: Requested vote from peers 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811), c124a08eb55d46688c2e3d4789977e47 (127.27.186.66:39141)
I20260811 16:42:48.675503 7388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "020071354a0e47788ee86f4e16fbce89" candidate_uuid: "bdeb827bb0514901a2253179bc85e89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c124a08eb55d46688c2e3d4789977e47"
I20260811 16:42:48.675519 7620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "020071354a0e47788ee86f4e16fbce89" candidate_uuid: "bdeb827bb0514901a2253179bc85e89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ae3049975694030b6d59d15fa2c5640"
I20260811 16:42:48.675597 7620 raft_consensus.cc:3037] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:48.675598 7388 raft_consensus.cc:3037] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:48.677023 7388 raft_consensus.cc:2454] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdeb827bb0514901a2253179bc85e89c in term 1.
I20260811 16:42:48.677024 7620 raft_consensus.cc:2454] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdeb827bb0514901a2253179bc85e89c in term 1.
I20260811 16:42:48.677201 7064 leader_election.cc:302] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ae3049975694030b6d59d15fa2c5640, bdeb827bb0514901a2253179bc85e89c; no voters:
I20260811 16:42:48.677311 7756 raft_consensus.cc:2781] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:48.677515 7756 raft_consensus.cc:686] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 1 LEADER]: Becoming Leader. State: Replica: bdeb827bb0514901a2253179bc85e89c, State: Running, Role: LEADER
I20260811 16:42:48.677649 7756 consensus_queue.cc:237] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } }
I20260811 16:42:48.678506 5630 catalog_manager.cc:5495] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c reported cstate change: term changed from 0 to 1, leader changed from <none> to bdeb827bb0514901a2253179bc85e89c (127.27.186.65). New cstate: current_term: 1 leader_uuid: "bdeb827bb0514901a2253179bc85e89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } health_report { overall_health: UNKNOWN } } }
I20260811 16:42:48.679308 6898 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: NON_VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: true } } }
I20260811 16:42:48.679421 6898 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:48.679989 6898 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: attempting to promote NON_VOTER 388845614fe244859371ab6470de260f to VOTER
I20260811 16:42:48.680135 6898 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } }
I20260811 16:42:48.680579 6978 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 LEARNER]: Refusing update from remote peer e5c960500c6d47e48f37fd3580254a1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 16:42:48.680717 6665 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Refusing update from remote peer e5c960500c6d47e48f37fd3580254a1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 16:42:48.680800 7765 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:42:48.680989 7768 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 16:42:48.681579 7765 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 388845614fe244859371ab6470de260f (127.27.186.124) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:48.681770 6978 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 388845614fe244859371ab6470de260f (127.27.186.124) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:48.682011 6665 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 388845614fe244859371ab6470de260f (127.27.186.124) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:48.682849 7765 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:48.682950 7765 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:48.682910 7019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:48.683000 7019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:48.683025 7765 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:48.683108 7765 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:48.683178 7765 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:48.683243 7765 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:48.683280 7772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5c960500c6d47e48f37fd3580254a1e" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:48.683373 7772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:48.690299 7735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.687607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51748 (local address 127.27.186.65:33529)
0811 16:42:48.687676 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.687678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.687687 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:48.687733 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.687733 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.687751 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.687803 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:48.688053 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.688559 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.689374 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.689668 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.689725 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.689936 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:48.690093 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:48.690161 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.690175 (+ 14us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.690195 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 16:42:48.692523 7388 raft_consensus.cc:1261] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 1 FOLLOWER]: Refusing update from remote peer bdeb827bb0514901a2253179bc85e89c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:48.692591 7620 raft_consensus.cc:1261] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 1 FOLLOWER]: Refusing update from remote peer bdeb827bb0514901a2253179bc85e89c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:48.692914 7756 consensus_queue.cc:1035] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:48.693115 7763 consensus_queue.cc:1035] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:48.696987 7775 mvcc.cc:205] Tried to move back new op lower bound from 7317367065361469440 to 7317367065304190976. Current Snapshot: MvccSnapshot[applied={T|T < 7317367065361469440}]
I20260811 16:42:48.698288 7776 mvcc.cc:205] Tried to move back new op lower bound from 7317367065361469440 to 7317367065304190976. Current Snapshot: MvccSnapshot[applied={T|T < 7317367065361469440}]
I20260811 16:42:48.698854 7777 mvcc.cc:205] Tried to move back new op lower bound from 7317367065361469440 to 7317367065304190976. Current Snapshot: MvccSnapshot[applied={T|T < 7317367065361469440}]
I20260811 16:42:48.699836 5627 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:48.699944 5627 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:48.701354 5627 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5c960500c6d47e48f37fd3580254a1e: Sending DeleteTablet for 3 replicas of tablet 020071354a0e47788ee86f4e16fbce89
I20260811 16:42:48.701758 7585 tablet_service.cc:1514] Processing DeleteTablet for tablet 020071354a0e47788ee86f4e16fbce89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:48 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:36862
I20260811 16:42:48.701980 7136 tablet_service.cc:1514] Processing DeleteTablet for tablet 020071354a0e47788ee86f4e16fbce89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:48 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:51736
I20260811 16:42:48.702167 7351 tablet_service.cc:1514] Processing DeleteTablet for tablet 020071354a0e47788ee86f4e16fbce89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:48 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:47262
I20260811 16:42:48.702291 7790 tablet_replica.cc:330] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: stopping tablet replica
I20260811 16:42:48.702409 7790 raft_consensus.cc:2229] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:48.702521 7790 raft_consensus.cc:2258] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:48.702775 7795 tablet_replica.cc:330] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: stopping tablet replica
I20260811 16:42:48.702930 7795 raft_consensus.cc:2229] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:48.703032 7790 ts_tablet_manager.cc:1905] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:48.703130 7795 raft_consensus.cc:2258] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:48.703464 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 5580
I20260811 16:42:48.721792 7792 tablet_replica.cc:330] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: stopping tablet replica
I20260811 16:42:48.721976 7792 raft_consensus.cc:2229] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:48.722118 7792 raft_consensus.cc:2258] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:48.722908 7792 ts_tablet_manager.cc:1905] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:48.725459 7792 ts_tablet_manager.cc:1918] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:48.725572 7792 log.cc:1196] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/020071354a0e47788ee86f4e16fbce89
I20260811 16:42:48.725636 7790 ts_tablet_manager.cc:1918] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:48.725739 7790 log.cc:1196] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/020071354a0e47788ee86f4e16fbce89
I20260811 16:42:48.725863 7792 ts_tablet_manager.cc:1939] T 020071354a0e47788ee86f4e16fbce89 P bdeb827bb0514901a2253179bc85e89c: Deleting consensus metadata
I20260811 16:42:48.726079 7790 ts_tablet_manager.cc:1939] T 020071354a0e47788ee86f4e16fbce89 P 5ae3049975694030b6d59d15fa2c5640: Deleting consensus metadata
I20260811 16:42:48.729868 7795 ts_tablet_manager.cc:1905] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:48.732041 7795 ts_tablet_manager.cc:1918] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:48.732139 7795 log.cc:1196] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/020071354a0e47788ee86f4e16fbce89
I20260811 16:42:48.732420 7795 ts_tablet_manager.cc:1939] T 020071354a0e47788ee86f4e16fbce89 P c124a08eb55d46688c2e3d4789977e47: Deleting consensus metadata
W20260811 16:42:48.733398 7277 connection.cc:535] server connection from 127.0.0.1:47262 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 16:42:48.733712 7061 connection.cc:535] server connection from 127.0.0.1:51736 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 16:42:48.733716 7507 connection.cc:535] server connection from 127.0.0.1:36862 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:42:48.734422 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.702455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37738 (local address 127.27.186.124:46571)
0811 16:42:48.702497 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.702499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.720920 (+ 18421us) server_negotiation.cc:407] Connection header received
0811 16:42:48.721087 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.721089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.721104 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.721139 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.726370 (+ 5231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.727179 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.728300 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.728605 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.728652 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.730439 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.730441 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.730442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.730450 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.732246 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.732762 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.732764 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.732764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.732822 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.733061 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.733063 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.733063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.733236 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.733347 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.734234 (+ 887us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.734325 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:42:48.743322 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.735773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37742 (local address 127.27.186.124:46571)
0811 16:42:48.735811 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.735813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.735866 (+ 53us) server_negotiation.cc:407] Connection header received
0811 16:42:48.735944 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.735945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.735952 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.736007 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.736561 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.737186 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.738276 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.738588 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.738665 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.740167 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.740169 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.740169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.740176 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.741996 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.742398 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.742400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.742400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.742458 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.742698 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.742700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.742700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.742838 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.742926 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.743133 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.743213 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 16:42:48.743413 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:48.735407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47928 (local address 127.27.186.125:38531)
0811 16:42:48.735454 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:48.735456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:48.735467 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:48.735511 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:48.735517 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:48.735530 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:48.735572 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:48.736675 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.737538 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.738511 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:48.738786 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:48.738862 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:48.740399 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:48.740400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:48.740401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:48.740409 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:48.742171 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.742598 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.742599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.742599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.742654 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:48.742867 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:48.742868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:48.742869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:48.742992 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:48.743094 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:48.743201 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 16:42:48.743289 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:42:49.698290 7807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:49.697934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:48797)
0811 16:42:49.698132 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:49.698224 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":91,"threads_started":1}
I20260811 16:42:49.698516 7809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:49.698185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:42011)
0811 16:42:49.698355 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:49.698465 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":51,"threads_started":1}
W20260811 16:42:49.698594 7236 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:37797 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
W20260811 16:42:49.698735 7465 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:37797 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:49.699373 7810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:49.699132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:41665)
0811 16:42:49.699221 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:49.699311 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":53,"threads_started":1}
W20260811 16:42:49.699667 7700 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:37797 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:50.202035 7812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5c960500c6d47e48f37fd3580254a1e)
I20260811 16:42:50.202097 7814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e5c960500c6d47e48f37fd3580254a1e)
I20260811 16:42:50.202215 7812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } }
I20260811 16:42:50.202255 7814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } }
I20260811 16:42:50.202553 7812 leader_election.cc:288] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797), 388845614fe244859371ab6470de260f (127.27.186.124:46571)
I20260811 16:42:50.202788 7814 leader_election.cc:288] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797), 667436fb21bf4f99930d7579be808ec9 (127.27.186.125:38531)
I20260811 16:42:50.202934 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.202697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48730)
0811 16:42:50.202828 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.202884 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":52,"threads_started":1}
W20260811 16:42:50.203052 6632 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:50.203387 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.203161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48742)
0811 16:42:50.203275 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.203345 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":76,"threads_started":1}
I20260811 16:42:50.203563 7825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.203472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48756)
0811 16:42:50.203506 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.203536 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260811 16:42:50.203644 6632 leader_election.cc:334] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797): Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
W20260811 16:42:50.203756 6938 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:50.204265 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.204157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48764)
0811 16:42:50.204214 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.204241 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 16:42:50.204365 6938 leader_election.cc:334] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797): Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:50.206416 7826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.202796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47940 (local address 127.27.186.125:38531)
0811 16:42:50.202892 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:50.202894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:50.203042 (+ 148us) server_negotiation.cc:407] Connection header received
0811 16:42:50.203156 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:50.203157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:50.203169 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:50.203218 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:50.203449 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:50.204271 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:50.205506 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:50.206074 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:50.206139 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:50.206153 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:50.206289 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:42:50.206329 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":38,"threads_started":1}
I20260811 16:42:50.206416 7827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.202863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37758 (local address 127.27.186.124:46571)
0811 16:42:50.203303 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:50.203305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:50.203312 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:42:50.203329 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:50.203329 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:50.203338 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:50.203553 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:50.203580 (+ 27us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:50.204330 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:50.205401 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:50.206002 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:50.206082 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:50.206093 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:50.206276 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 16:42:50.206329 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":57,"threads_started":1}
I20260811 16:42:50.206418 7823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.202699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:38531 (local address 127.0.0.1:47940)
0811 16:42:50.202952 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.202980 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:50.203074 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:50.203298 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:50.203299 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:50.203302 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:50.203367 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:50.203369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:50.204453 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:50.204454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:50.205378 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:50.205381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:50.206149 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:50.206150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:50.206214 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:50.206219 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:50.206274 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:42:50.206316 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":50,"threads_started":1}
I20260811 16:42:50.206422 7821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.202701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:46571 (local address 127.0.0.1:37758)
0811 16:42:50.203029 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.203040 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:50.203097 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:50.203444 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:50.203444 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:50.203446 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:50.203490 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:50.203492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:50.204418 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:50.204419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:50.205311 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:50.205314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:50.206088 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:50.206089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:50.206174 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:50.206179 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:50.206243 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:42:50.206294 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":62,"threads_started":1}
I20260811 16:42:50.206663 6978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "667436fb21bf4f99930d7579be808ec9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "388845614fe244859371ab6470de260f" is_pre_election: true
I20260811 16:42:50.206676 6665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "388845614fe244859371ab6470de260f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "667436fb21bf4f99930d7579be808ec9" is_pre_election: true
I20260811 16:42:50.206799 6665 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388845614fe244859371ab6470de260f in term 1.
I20260811 16:42:50.206799 6978 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 667436fb21bf4f99930d7579be808ec9 in term 1.
I20260811 16:42:50.207015 6629 leader_election.cc:302] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388845614fe244859371ab6470de260f, 667436fb21bf4f99930d7579be808ec9; no voters: e5c960500c6d47e48f37fd3580254a1e
I20260811 16:42:50.207051 6934 leader_election.cc:302] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388845614fe244859371ab6470de260f, 667436fb21bf4f99930d7579be808ec9; no voters: e5c960500c6d47e48f37fd3580254a1e
I20260811 16:42:50.207159 7812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:42:50.207173 7814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 16:42:50.207216 7814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5c960500c6d47e48f37fd3580254a1e)
I20260811 16:42:50.207217 7812 raft_consensus.cc:482] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e5c960500c6d47e48f37fd3580254a1e)
I20260811 16:42:50.207244 7812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:42:50.207229 7814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:42:50.207978 7812 raft_consensus.cc:504] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } }
I20260811 16:42:50.208015 7814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } }
I20260811 16:42:50.208134 7812 leader_election.cc:288] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [CANDIDATE]: Term 2 election: Requested vote from peers e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797), 388845614fe244859371ab6470de260f (127.27.186.124:46571)
I20260811 16:42:50.208158 7814 leader_election.cc:288] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 2 election: Requested vote from peers e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797), 667436fb21bf4f99930d7579be808ec9 (127.27.186.125:38531)
I20260811 16:42:50.208335 7821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.208211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48766)
0811 16:42:50.208268 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.208304 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 16:42:50.208328 6978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "667436fb21bf4f99930d7579be808ec9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "388845614fe244859371ab6470de260f"
I20260811 16:42:50.208356 6665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "388845614fe244859371ab6470de260f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "667436fb21bf4f99930d7579be808ec9"
I20260811 16:42:50.208420 6665 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 388845614fe244859371ab6470de260f in current term 2: Already voted for candidate 667436fb21bf4f99930d7579be808ec9 in this term.
I20260811 16:42:50.208416 6978 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 667436fb21bf4f99930d7579be808ec9 in current term 2: Already voted for candidate 388845614fe244859371ab6470de260f in this term.
I20260811 16:42:50.208425 7823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.208337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48774)
0811 16:42:50.208376 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.208400 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 16:42:50.208763 7821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.208670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48802)
0811 16:42:50.208716 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.208743 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 16:42:50.208722 7828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.208618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:48788)
0811 16:42:50.208651 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.208672 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 16:42:50.208827 6938 leader_election.cc:334] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797): Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:50.208855 6938 leader_election.cc:302] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 388845614fe244859371ab6470de260f; no voters: 667436fb21bf4f99930d7579be808ec9, e5c960500c6d47e48f37fd3580254a1e
W20260811 16:42:50.208845 6632 leader_election.cc:334] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797): Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:50.208890 6632 leader_election.cc:302] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 667436fb21bf4f99930d7579be808ec9; no voters: 388845614fe244859371ab6470de260f, e5c960500c6d47e48f37fd3580254a1e
I20260811 16:42:50.208941 7814 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:42:50.208963 7812 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 16:42:50.699290 7832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.698994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:35661)
0811 16:42:50.699174 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.699230 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":90,"threads_started":1}
I20260811 16:42:50.699378 7833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.699029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:34085)
0811 16:42:50.699278 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.699320 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":71,"threads_started":1}
I20260811 16:42:50.700176 7835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:50.699937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:50445)
0811 16:42:50.700087 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:50.700130 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
I20260811 16:42:51.700054 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.699800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:48483)
0811 16:42:51.699952 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.699994 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":70,"threads_started":1}
I20260811 16:42:51.700326 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.699842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:50995)
0811 16:42:51.700244 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.700283 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":64,"threads_started":1}
I20260811 16:42:51.700816 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.700594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:47847)
0811 16:42:51.700743 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.700783 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":51,"threads_started":1}
I20260811 16:42:51.885164 7843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:51.885278 7843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } }
I20260811 16:42:51.885555 7843 leader_election.cc:288] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797), 667436fb21bf4f99930d7579be808ec9 (127.27.186.125:38531)
I20260811 16:42:51.885859 6665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "388845614fe244859371ab6470de260f" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "667436fb21bf4f99930d7579be808ec9" is_pre_election: true
I20260811 16:42:51.885936 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.885713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:49060)
0811 16:42:51.885851 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.885893 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260811 16:42:51.885973 6665 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388845614fe244859371ab6470de260f in term 2.
I20260811 16:42:51.886175 6934 leader_election.cc:302] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388845614fe244859371ab6470de260f, 667436fb21bf4f99930d7579be808ec9; no voters:
I20260811 16:42:51.886284 7843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 16:42:51.886384 7843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:51.886408 7843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:42:51.886516 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.886411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:49066)
0811 16:42:51.886459 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.886485 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 16:42:51.886616 6938 leader_election.cc:334] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797): Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:51.887245 7843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } }
I20260811 16:42:51.887396 7843 leader_election.cc:288] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 3 election: Requested vote from peers e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797), 667436fb21bf4f99930d7579be808ec9 (127.27.186.125:38531)
I20260811 16:42:51.887625 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.887513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:49070)
0811 16:42:51.887564 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.887593 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 16:42:51.887621 6665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "388845614fe244859371ab6470de260f" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "667436fb21bf4f99930d7579be808ec9"
I20260811 16:42:51.887699 6665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:42:51.888010 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.887909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:49086)
0811 16:42:51.887961 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.887987 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 16:42:51.888139 6938 leader_election.cc:334] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797): Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
I20260811 16:42:51.888497 6665 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388845614fe244859371ab6470de260f in term 3.
I20260811 16:42:51.888672 6934 leader_election.cc:302] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388845614fe244859371ab6470de260f, 667436fb21bf4f99930d7579be808ec9; no voters: e5c960500c6d47e48f37fd3580254a1e
I20260811 16:42:51.888799 7843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:42:51.888972 7843 raft_consensus.cc:686] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [term 3 LEADER]: Becoming Leader. State: Replica: 388845614fe244859371ab6470de260f, State: Running, Role: LEADER
I20260811 16:42:51.889084 7843 consensus_queue.cc:237] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } }
I20260811 16:42:51.889570 7848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 388845614fe244859371ab6470de260f. Latest consensus state: current_term: 3 leader_uuid: "388845614fe244859371ab6470de260f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:51.889690 7848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:51.889964 7851 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:51.890427 7851 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:51.890493 7851 catalog_manager.cc:1259] Loaded cluster ID: 8c1e49ab061e4f4aa84f93217180cd70
I20260811 16:42:51.890549 7851 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:51.890735 7851 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:51.890822 7851 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Loaded TSK: 0
I20260811 16:42:51.890978 7851 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:42:51.913406 6959 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:51.915187 6959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:51.916215 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.916100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:49106)
0811 16:42:51.916153 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.916188 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 16:42:51.916265 6665 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [term 3 FOLLOWER]: Refusing update from remote peer 388845614fe244859371ab6470de260f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 16:42:51.916590 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.916476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.0.0.1:49120)
0811 16:42:51.916533 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.916568 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:42:51.916538 7848 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [LEADER]: Connected to new peer: Peer: permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 16:42:51.916685 6938 consensus_peers.cc:487] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f -> Peer e5c960500c6d47e48f37fd3580254a1e (127.27.186.126:37797): Couldn't send request to peer e5c960500c6d47e48f37fd3580254a1e. Status: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 16:42:51.917194 7858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 388845614fe244859371ab6470de260f. Latest consensus state: current_term: 3 leader_uuid: "388845614fe244859371ab6470de260f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:51.917318 7858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:51.919876 7843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "388845614fe244859371ab6470de260f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:51.919896 7858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "388845614fe244859371ab6470de260f" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "e5c960500c6d47e48f37fd3580254a1e" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37797 } } peers { permanent_uuid: "667436fb21bf4f99930d7579be808ec9" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 38531 } attrs { promote: false } } peers { permanent_uuid: "388845614fe244859371ab6470de260f" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 46571 } attrs { promote: false } } }
I20260811 16:42:51.919973 7858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 667436fb21bf4f99930d7579be808ec9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:42:51.919974 7843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:51.925340 7867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.921933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:33529 (local address 127.0.0.1:51762)
0811 16:42:51.922059 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.922067 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:51.922129 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:51.922491 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:51.922491 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:51.922493 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:51.922532 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.922533 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.923426 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.923427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.924289 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.924292 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.925057 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.925059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.925122 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.925126 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:51.925211 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:42:51.925250 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":1,"thread_start_us":88,"threads_started":1}
I20260811 16:42:51.925340 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.922174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51762 (local address 127.27.186.65:33529)
0811 16:42:51.922361 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:51.922363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:51.922372 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:51.922399 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:51.922400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:51.922409 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:51.922488 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:51.922620 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.923334 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.924394 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.924968 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.925058 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.925071 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:51.925220 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 16:42:51.925266 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":78,"threads_started":1}
I20260811 16:42:51.925606 7136 tablet_service.cc:1467] Processing CreateTablet for tablet 804d799a2c874ca9b3a1883a1083c08c (DEFAULT_TABLE table=test-table [id=84eac75557954c319a7f5817884dba18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:51.925683 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.921851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:39141 (local address 127.0.0.1:47268)
0811 16:42:51.921892 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.921903 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:51.921954 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:51.922275 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:51.922276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:51.922278 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:51.922339 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.922341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.923416 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.923417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.924704 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.924706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.925443 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.925445 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.925547 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.925551 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:51.925580 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 16:42:51.925620 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":97}
I20260811 16:42:51.925761 7136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 804d799a2c874ca9b3a1883a1083c08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:51.925968 7865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.921931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47268 (local address 127.27.186.66:39141)
0811 16:42:51.922101 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:51.922103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:51.922114 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:51.922147 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:51.922148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:51.922161 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:51.922448 (+ 287us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:51.922493 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.923309 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.924803 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.925346 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.925794 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.925812 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:51.925835 (+ 23us) server_negotiation.cc:299] Negotiation successful
0811 16:42:51.925899 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20260811 16:42:51.926194 7351 tablet_service.cc:1467] Processing CreateTablet for tablet 804d799a2c874ca9b3a1883a1083c08c (DEFAULT_TABLE table=test-table [id=84eac75557954c319a7f5817884dba18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:51.926323 7351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 804d799a2c874ca9b3a1883a1083c08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:51.926561 7866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.921935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38811 (local address 127.0.0.1:36868)
0811 16:42:51.922208 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.922217 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:51.922253 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:51.922716 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:51.922716 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:51.922718 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:51.922764 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.922765 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.923648 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.923649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.924980 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.924983 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.926332 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.926333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.926396 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.926400 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:51.926457 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:42:51.926494 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":1,"thread_start_us":84,"threads_started":1}
I20260811 16:42:51.926864 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.922192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36868 (local address 127.27.186.67:38811)
0811 16:42:51.922592 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:51.922595 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:51.922603 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:51.922629 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:51.922629 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:51.922640 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:51.922698 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:51.922836 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.923320 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.925072 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.926206 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.926331 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.926344 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:51.926466 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 16:42:51.926506 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":64,"threads_started":1}
I20260811 16:42:51.927310 7873 tablet_bootstrap.cc:492] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c: Bootstrap starting.
I20260811 16:42:51.927670 7873 tablet_bootstrap.cc:654] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:51.927810 7874 tablet_bootstrap.cc:492] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: Bootstrap starting.
I20260811 16:42:51.928188 7585 tablet_service.cc:1467] Processing CreateTablet for tablet 804d799a2c874ca9b3a1883a1083c08c (DEFAULT_TABLE table=test-table [id=84eac75557954c319a7f5817884dba18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:51.928251 7874 tablet_bootstrap.cc:654] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:51.928239 7873 tablet_bootstrap.cc:492] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c: No bootstrap required, opened a new log
I20260811 16:42:51.928311 7873 ts_tablet_manager.cc:1397] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:51.928328 7585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 804d799a2c874ca9b3a1883a1083c08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:51.928467 7873 raft_consensus.cc:348] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:51.928557 7873 raft_consensus.cc:374] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:51.928589 7873 raft_consensus.cc:729] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdeb827bb0514901a2253179bc85e89c, State: Initialized, Role: FOLLOWER
I20260811 16:42:51.928648 7873 consensus_queue.cc:260] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:51.928843 7873 ts_tablet_manager.cc:1428] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:51.928985 7874 tablet_bootstrap.cc:492] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: No bootstrap required, opened a new log
I20260811 16:42:51.929039 7874 ts_tablet_manager.cc:1397] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:51.929201 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.929103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:51203)
0811 16:42:51.929141 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.929172 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 16:42:51.929165 7874 raft_consensus.cc:348] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:51.929239 7874 raft_consensus.cc:374] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:51.929265 7874 raft_consensus.cc:729] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c124a08eb55d46688c2e3d4789977e47, State: Initialized, Role: FOLLOWER
I20260811 16:42:51.929337 7874 consensus_queue.cc:260] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:51.929543 7874 ts_tablet_manager.cc:1428] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:51.929939 7881 tablet_bootstrap.cc:492] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: Bootstrap starting.
I20260811 16:42:51.930213 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.930119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:59799)
0811 16:42:51.930154 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.930184 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 16:42:51.930330 7881 tablet_bootstrap.cc:654] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:51.930959 7881 tablet_bootstrap.cc:492] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: No bootstrap required, opened a new log
I20260811 16:42:51.931026 7881 ts_tablet_manager.cc:1397] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:51.931143 7881 raft_consensus.cc:348] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:51.931216 7881 raft_consensus.cc:374] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:51.931247 7881 raft_consensus.cc:729] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ae3049975694030b6d59d15fa2c5640, State: Initialized, Role: FOLLOWER
I20260811 16:42:51.931320 7234 heartbeater.cc:503] Master 127.27.186.124:46571 was elected leader, sending a full tablet report...
I20260811 16:42:51.931329 7881 consensus_queue.cc:260] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:51.931386 7464 heartbeater.cc:503] Master 127.27.186.124:46571 was elected leader, sending a full tablet report...
I20260811 16:42:51.931515 7881 ts_tablet_manager.cc:1428] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:51.931785 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.931690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:42891)
0811 16:42:51.931731 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.931759 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:42:51.931936 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.931841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:46641)
0811 16:42:51.931882 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.931910 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 16:42:51.932392 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.932259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:33215)
0811 16:42:51.932323 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.932355 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 16:42:51.932593 7697 heartbeater.cc:503] Master 127.27.186.124:46571 was elected leader, sending a full tablet report...
I20260811 16:42:51.932936 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.932839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:57245)
0811 16:42:51.932880 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.932912 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260811 16:42:51.995397 7879 raft_consensus.cc:482] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:51.995525 7879 raft_consensus.cc:504] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:51.995930 7879 leader_election.cc:288] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdeb827bb0514901a2253179bc85e89c (127.27.186.65:33529), 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811)
I20260811 16:42:51.999457 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.996183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:51741 (local address 127.27.186.67:38811)
0811 16:42:51.996237 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:51.996239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:51.996250 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:51.996296 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:51.996297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:51.996308 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:51.996392 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:51.996591 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.997395 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.998533 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.999069 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.999147 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.999158 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:51.999340 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 16:42:51.999381 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:42:51.999457 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.996183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:51827 (local address 127.27.186.65:33529)
0811 16:42:51.996238 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:51.996240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:51.996410 (+ 170us) server_negotiation.cc:407] Connection header received
0811 16:42:51.996443 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:51.996444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:51.996455 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:51.996505 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:51.996679 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.997458 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.998514 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.999070 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.999147 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.999159 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:51.999340 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 16:42:51.999389 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:42:51.999508 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.996094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38811 (local address 127.27.186.66:51741)
0811 16:42:51.996133 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.996146 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:51.996205 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:51.996421 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:51.996422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:51.996424 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:51.996510 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.996512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.997523 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.997525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.998361 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.998363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.999162 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.999164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.999236 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.999244 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 16:42:51.999307 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:42:51.999400 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18,"mutex_wait_us":8}
I20260811 16:42:51.999508 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:51.996094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:33529 (local address 127.27.186.66:51827)
0811 16:42:51.996300 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:51.996311 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:51.996388 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:51.996527 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:51.996528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:51.996529 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:51.996587 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.996588 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.997561 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.997562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.998362 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:51.998364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:51.999166 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:51.999166 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:51.999236 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:51.999243 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 16:42:51.999307 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:42:51.999376 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":69,"thread_start_us":122,"threads_started":1}
I20260811 16:42:51.999843 7620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "804d799a2c874ca9b3a1883a1083c08c" candidate_uuid: "c124a08eb55d46688c2e3d4789977e47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ae3049975694030b6d59d15fa2c5640" is_pre_election: true
I20260811 16:42:51.999943 7620 raft_consensus.cc:2454] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c124a08eb55d46688c2e3d4789977e47 in term 0.
I20260811 16:42:51.999868 7164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "804d799a2c874ca9b3a1883a1083c08c" candidate_uuid: "c124a08eb55d46688c2e3d4789977e47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdeb827bb0514901a2253179bc85e89c" is_pre_election: true
I20260811 16:42:52.000027 7164 raft_consensus.cc:2454] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c124a08eb55d46688c2e3d4789977e47 in term 0.
I20260811 16:42:52.000267 7277 leader_election.cc:302] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ae3049975694030b6d59d15fa2c5640, c124a08eb55d46688c2e3d4789977e47; no voters:
I20260811 16:42:52.000417 7879 raft_consensus.cc:2781] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:52.000461 7879 raft_consensus.cc:482] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:52.000483 7879 raft_consensus.cc:3037] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:52.001199 7879 raft_consensus.cc:504] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:52.001348 7879 leader_election.cc:288] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [CANDIDATE]: Term 1 election: Requested vote from peers bdeb827bb0514901a2253179bc85e89c (127.27.186.65:33529), 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811)
I20260811 16:42:52.001523 7620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "804d799a2c874ca9b3a1883a1083c08c" candidate_uuid: "c124a08eb55d46688c2e3d4789977e47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ae3049975694030b6d59d15fa2c5640"
I20260811 16:42:52.001566 7164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "804d799a2c874ca9b3a1883a1083c08c" candidate_uuid: "c124a08eb55d46688c2e3d4789977e47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdeb827bb0514901a2253179bc85e89c"
I20260811 16:42:52.001653 7164 raft_consensus.cc:3037] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:52.001658 7620 raft_consensus.cc:3037] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:52.002348 7164 raft_consensus.cc:2454] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c124a08eb55d46688c2e3d4789977e47 in term 1.
I20260811 16:42:52.002368 7620 raft_consensus.cc:2454] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c124a08eb55d46688c2e3d4789977e47 in term 1.
I20260811 16:42:52.002550 7270 leader_election.cc:302] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdeb827bb0514901a2253179bc85e89c, c124a08eb55d46688c2e3d4789977e47; no voters:
I20260811 16:42:52.002669 7879 raft_consensus.cc:2781] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:52.002833 7879 raft_consensus.cc:686] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 1 LEADER]: Becoming Leader. State: Replica: c124a08eb55d46688c2e3d4789977e47, State: Running, Role: LEADER
I20260811 16:42:52.002902 7879 consensus_queue.cc:237] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } }
I20260811 16:42:52.003423 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:52.003274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:58611)
0811 16:42:52.003340 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:52.003382 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 16:42:52.003751 6957 catalog_manager.cc:5495] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 reported cstate change: term changed from 0 to 1, leader changed from <none> to c124a08eb55d46688c2e3d4789977e47 (127.27.186.66). New cstate: current_term: 1 leader_uuid: "c124a08eb55d46688c2e3d4789977e47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c124a08eb55d46688c2e3d4789977e47" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 } health_report { overall_health: UNKNOWN } } }
W20260811 16:42:52.005282 7239 tablet.cc:2369] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:52.018812 7865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:52.016279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47284 (local address 127.27.186.66:39141)
0811 16:42:52.016350 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:52.016352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:52.016360 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:52.016447 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:52.016448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:52.016469 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:52.016533 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:52.016669 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:52.017212 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:52.018077 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:52.018267 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:52.018322 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:52.018477 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:52.018580 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:52.018635 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:52.018677 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 16:42:52.018697 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:42:52.020058 7620 raft_consensus.cc:1261] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 1 FOLLOWER]: Refusing update from remote peer c124a08eb55d46688c2e3d4789977e47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:52.020152 7164 raft_consensus.cc:1261] T 804d799a2c874ca9b3a1883a1083c08c P bdeb827bb0514901a2253179bc85e89c [term 1 FOLLOWER]: Refusing update from remote peer c124a08eb55d46688c2e3d4789977e47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:52.020401 7879 consensus_queue.cc:1035] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ae3049975694030b6d59d15fa2c5640" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:52.020526 7887 consensus_queue.cc:1035] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdeb827bb0514901a2253179bc85e89c" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:52.021538 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:52.021234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:56673)
0811 16:42:52.021435 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:52.021497 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260811 16:42:52.021706 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:52.021588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:47247)
0811 16:42:52.021639 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:52.021671 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 16:42:52.022871 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:52.022754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.67:46169)
0811 16:42:52.022805 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:52.022829 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 16:42:52.022948 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:52.022743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.66:57771)
0811 16:42:52.022887 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:52.022915 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260811 16:42:52.024444 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:52.024266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37797 (local address 127.27.186.65:58301)
0811 16:42:52.024387 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:52.024421 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:37797: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260811 16:42:52.025308 6959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:52.025414 6959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:52.026778 6959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 388845614fe244859371ab6470de260f: Sending DeleteTablet for 3 replicas of tablet 804d799a2c874ca9b3a1883a1083c08c
I20260811 16:42:52.027143 7585 tablet_service.cc:1514] Processing DeleteTablet for tablet 804d799a2c874ca9b3a1883a1083c08c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:52 UTC) from {username='oryx', principal='oryx/127.27.186.124@KRBTEST.COM'} at 127.0.0.1:36868
I20260811 16:42:52.027192 7136 tablet_service.cc:1514] Processing DeleteTablet for tablet 804d799a2c874ca9b3a1883a1083c08c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:52 UTC) from {username='oryx', principal='oryx/127.27.186.124@KRBTEST.COM'} at 127.0.0.1:51762
I20260811 16:42:52.027340 7907 tablet_replica.cc:330] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: stopping tablet replica
I20260811 16:42:52.027390 7907 raft_consensus.cc:2229] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:52.027428 7907 raft_consensus.cc:2258] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:52.027556 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 6888
I20260811 16:42:52.028239 7907 ts_tablet_manager.cc:1905] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:52.037441 7351 tablet_service.cc:1514] Processing DeleteTablet for tablet 804d799a2c874ca9b3a1883a1083c08c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:52 UTC) from {username='oryx', principal='oryx/127.27.186.124@KRBTEST.COM'} at 127.0.0.1:47268
I20260811 16:42:52.037583 7907 ts_tablet_manager.cc:1918] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:52.037657 7907 log.cc:1196] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/804d799a2c874ca9b3a1883a1083c08c
I20260811 16:42:52.037927 7907 ts_tablet_manager.cc:1939] T 804d799a2c874ca9b3a1883a1083c08c P 5ae3049975694030b6d59d15fa2c5640: Deleting consensus metadata
I20260811 16:42:52.038041 7911 tablet_replica.cc:330] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: stopping tablet replica
I20260811 16:42:52.038156 7911 raft_consensus.cc:2229] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:52.038327 7911 raft_consensus.cc:2258] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:52.038333 6939 catalog_manager.cc:4841] TS 5ae3049975694030b6d59d15fa2c5640 (127.27.186.67:38811): tablet 804d799a2c874ca9b3a1883a1083c08c (table test-table [id=84eac75557954c319a7f5817884dba18]) successfully deleted
I20260811 16:42:52.038736 7911 ts_tablet_manager.cc:1905] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:52.040674 7911 ts_tablet_manager.cc:1918] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:52.040859 7911 log.cc:1196] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/804d799a2c874ca9b3a1883a1083c08c
I20260811 16:42:52.041131 7911 ts_tablet_manager.cc:1939] T 804d799a2c874ca9b3a1883a1083c08c P c124a08eb55d46688c2e3d4789977e47: Deleting consensus metadata
I20260811 16:42:52.041544 6934 catalog_manager.cc:4841] TS c124a08eb55d46688c2e3d4789977e47 (127.27.186.66:39141): tablet 804d799a2c874ca9b3a1883a1083c08c (table test-table [id=84eac75557954c319a7f5817884dba18]) successfully deleted
I20260811 16:42:52.052651 7866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:52.052490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:33529 (local address 127.0.0.1:51764)
0811 16:42:52.052560 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:52.052599 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:33529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 16:42:52.052795 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 7247
W20260811 16:42:52.059894 6932 catalog_manager.cc:4584] TS bdeb827bb0514901a2253179bc85e89c (127.27.186.65:33529): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 804d799a2c874ca9b3a1883a1083c08c: Network error: Client connection negotiation failed: client connection to 127.27.186.65:33529: connect: Connection refused (error 111)
I20260811 16:42:52.066434 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 7473
I20260811 16:42:52.080857 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 6441
I20260811 16:42:52.090766 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 6746
2026-08-11T16:42:52Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6727 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:52 dist-test-slave-gsp7 krb5kdc[7915](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:52 dist-test-slave-gsp7 krb5kdc[7915](info): set up 2 sockets
Aug 11 16:42:52 dist-test-slave-gsp7 krb5kdc[7915](info): commencing operation
krb5kdc: starting...
W20260811 16:42:53.375528 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:53 dist-test-slave-gsp7 krb5kdc[7915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:53Z Disabled control of system clock
WARNING: no policy specified for oryx/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.126.keytab.
Entry for principal oryx/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.126.keytab.
I20260811 16:42:53.507023 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45757
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.126.keytab
--principal=oryx/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:45757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:53.593123 7930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:53.593367 7930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:53.593392 7930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:53.594691 7930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:53.594736 7930 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 16:42:53.594750 7930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:53.594764 7930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:53.594777 7930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:53.594792 7930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:53.596421 7930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:45757
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.126.keytab
--principal=oryx/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:53.596706 7930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:53.596968 7930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:53.602046 7942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:53.602072 7944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:53.602073 7940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:53.602466 7930 server_base.cc:1034] running on GCE node
I20260811 16:42:53.602752 7930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:53.603122 7930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:53.604272 7930 hybrid_clock.cc:648] HybridClock initialized: now 1786466573604250 us; error 41 us; skew 500 ppm
Aug 11 16:42:53 dist-test-slave-gsp7 krb5kdc[7915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466573, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:53.607194 7930 init.cc:377] Logged in from keytab as oryx/127.27.186.126@KRBTEST.COM (short username oryx)
I20260811 16:42:53.607702 7930 webserver.cc:460] Webserver started at http://127.27.186.126:35873/ using document root <none> and password file <none>
I20260811 16:42:53.607952 7930 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:53.608028 7930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:53.608191 7930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:53.609373 7930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "bb66c2f541fe4c97bdf7d0e615653039"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "526667882f49b9b320c89194286a8e28"
server_key_iv: "908d8cdd40e4bff3786f287d23b9fb96"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.609869 7930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "bb66c2f541fe4c97bdf7d0e615653039"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "526667882f49b9b320c89194286a8e28"
server_key_iv: "908d8cdd40e4bff3786f287d23b9fb96"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.611445 7930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:53.612396 7955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:53.612732 7930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:53.612841 7930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "bb66c2f541fe4c97bdf7d0e615653039"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "526667882f49b9b320c89194286a8e28"
server_key_iv: "908d8cdd40e4bff3786f287d23b9fb96"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.612907 7930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:53.625000 7930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:53.627019 7930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:53.627138 7930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:53.631896 7930 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:45757
I20260811 16:42:53.632019 8054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:45757 every 8 connection(s)
I20260811 16:42:53.632339 7930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:53.632962 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 7930
I20260811 16:42:53.633070 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:53.633208 8059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:53.633316 28393 external_mini_cluster.cc:1428] Setting key 784c4da2056393990ae2bbbe0240a402
I20260811 16:42:53.636104 8059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: Bootstrap starting.
I20260811 16:42:53.636730 8059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:53.637046 8059 log.cc:824] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:53.637758 8059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: No bootstrap required, opened a new log
Aug 11 16:42:53 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:53.640277 8059 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb66c2f541fe4c97bdf7d0e615653039" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45757 } }
I20260811 16:42:53.640435 8059 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:53.640461 8059 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb66c2f541fe4c97bdf7d0e615653039, State: Initialized, Role: FOLLOWER
I20260811 16:42:53.640620 8059 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb66c2f541fe4c97bdf7d0e615653039" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45757 } }
I20260811 16:42:53.640686 8059 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:53.640708 8059 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:53.640771 8059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:53.641463 8059 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb66c2f541fe4c97bdf7d0e615653039" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45757 } }
I20260811 16:42:53.641633 8059 leader_election.cc:302] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb66c2f541fe4c97bdf7d0e615653039; no voters:
I20260811 16:42:53.641860 8059 leader_election.cc:288] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:53.641893 8065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:53.642112 8065 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [term 1 LEADER]: Becoming Leader. State: Replica: bb66c2f541fe4c97bdf7d0e615653039, State: Running, Role: LEADER
I20260811 16:42:53.642144 8059 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:53.642225 8065 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb66c2f541fe4c97bdf7d0e615653039" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45757 } }
I20260811 16:42:53.642601 8065 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb66c2f541fe4c97bdf7d0e615653039. Latest consensus state: current_term: 1 leader_uuid: "bb66c2f541fe4c97bdf7d0e615653039" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb66c2f541fe4c97bdf7d0e615653039" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45757 } } }
I20260811 16:42:53.642683 8065 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:53.642611 8066 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb66c2f541fe4c97bdf7d0e615653039" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb66c2f541fe4c97bdf7d0e615653039" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45757 } } }
I20260811 16:42:53.642735 8066 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039 [sys.catalog]: This master's current role is: LEADER
W20260811 16:42:53.644037 8084 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:42:53.644102 8084 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:42:53.644205 8076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:53.644415 8076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:53.645577 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.633880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55236 (local address 127.27.186.126:45757)
0811 16:42:53.634089 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:53.634099 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:53.634137 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:42:53.634674 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:53.634681 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:53.634726 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:53.634904 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:53.635556 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.636532 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.637443 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.637964 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.638095 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:53.640861 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:53.640865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:53.640865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:53.640878 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:53.643288 (+ 2410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:53.643822 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:53.643826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:53.643827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:53.643934 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:53.644190 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:53.644192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:53.644192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:53.644551 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:53.644722 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:53.645191 (+ 469us) server_negotiation.cc:299] Negotiation successful
0811 16:42:53.645341 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":85,"threads_started":1}
I20260811 16:42:53.646613 8076 catalog_manager.cc:1347] Generated new cluster ID: 2a9309511dcc4fed8b3cdf135010eb23
I20260811 16:42:53.646690 8076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:53.663760 8076 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:53.664306 8076 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:53.667655 8076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: Generated new TSK 0
I20260811 16:42:53.667850 8076 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab.
Entry for principal oryx/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab.
I20260811 16:42:53.701071 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45757
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab
--principal=oryx/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:53.785538 8093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:53.785817 8093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:53.785866 8093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:53.787248 8093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:53.787339 8093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:53.787379 8093 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:53.787425 8093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:53.789075 8093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab
--principal=oryx/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:45757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:53.789381 8093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:53.789673 8093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:53.795013 8104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:53.795022 8110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:53.795122 8106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:53.795387 8093 server_base.cc:1034] running on GCE node
I20260811 16:42:53.795644 8093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:53.795945 8093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:53.797132 8093 hybrid_clock.cc:648] HybridClock initialized: now 1786466573797134 us; error 103 us; skew 500 ppm
Aug 11 16:42:53 dist-test-slave-gsp7 krb5kdc[7915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466573, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:53.799896 8093 init.cc:377] Logged in from keytab as oryx/127.27.186.65@KRBTEST.COM (short username oryx)
I20260811 16:42:53.800385 8093 webserver.cc:460] Webserver started at http://127.27.186.65:43779/ using document root <none> and password file <none>
I20260811 16:42:53.800645 8093 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:53.800715 8093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:53.800865 8093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:53.802122 8093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "f3d1fd7ae70d4038aa6234d035c872de"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "8e7a9b536a8983955546dec3f37842ee"
server_key_iv: "2126383bc0d7e195cb8dfda6b67ff8e1"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.802548 8093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "f3d1fd7ae70d4038aa6234d035c872de"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "8e7a9b536a8983955546dec3f37842ee"
server_key_iv: "2126383bc0d7e195cb8dfda6b67ff8e1"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.804064 8093 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:53.804853 8122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:53.805056 8093 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:53.805171 8093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "f3d1fd7ae70d4038aa6234d035c872de"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "8e7a9b536a8983955546dec3f37842ee"
server_key_iv: "2126383bc0d7e195cb8dfda6b67ff8e1"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.805248 8093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:53.813966 8093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:53.816192 8093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:53.816370 8093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:53.817231 8093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:53.817303 8093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:53.817350 8093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:53.817379 8093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:42:53 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466573, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:53.825802 8093 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:33155
I20260811 16:42:53.825918 8308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:33155 every 8 connection(s)
I20260811 16:42:53.826247 8093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:53.827430 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 8093
I20260811 16:42:53.827559 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:53.827752 28393 external_mini_cluster.cc:1428] Setting key a450b17940a3a9bf7f6cf4e9d95268c4
I20260811 16:42:53.828876 8142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.817560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45757 (local address 127.27.186.65:58175)
0811 16:42:53.817741 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:53.817793 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:53.818615 (+ 822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:53.818902 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:53.818906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:53.819358 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:53.819706 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:53.819716 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.820781 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.820782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:53.821973 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:53.821977 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.822431 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.822433 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:53.822578 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:53.823167 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:53.823185 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:53.825282 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:53.827205 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:53.827234 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:53.827236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:53.827579 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:53.827805 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:53.827806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:53.827806 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:53.827968 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:53.828280 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:53.828287 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:53.828466 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 16:42:53.828584 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 16:42:53.828716 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
I20260811 16:42:53.828876 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.817570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:58175 (local address 127.27.186.126:45757)
0811 16:42:53.817652 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:53.817654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:53.817907 (+ 253us) server_negotiation.cc:407] Connection header received
0811 16:42:53.818743 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:53.818745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:53.818756 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:53.818801 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:53.819855 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.820683 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.822086 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.822320 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.822402 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:53.825397 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:53.825398 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:53.825398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:53.825406 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:53.827093 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:53.827677 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:53.827679 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:53.827679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:53.827732 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:53.828063 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:53.828064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:53.828064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:53.828205 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:53.828267 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:53.828641 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 16:42:53.828740 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:42:53.830701 8310 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45757
I20260811 16:42:53.830806 8310 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:53.831028 8310 heartbeater.cc:511] Master 127.27.186.126:45757 requested a full tablet report, sending...
I20260811 16:42:53.831607 7983 ts_manager.cc:194] Registered new tserver with Master: f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155)
I20260811 16:42:53.832576 7983 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:58175
WARNING: no policy specified for oryx/127.27.186.66@KRBTEST.COM; defaulting to no policy
I20260811 16:42:53.838277 8322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.831781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45757 (local address 127.27.186.65:59555)
0811 16:42:53.831913 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:53.831924 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:53.831998 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:53.832129 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:53.832129 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:53.832328 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:53.832417 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:53.832419 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.833413 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.833414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:53.833947 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:53.833949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.834490 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.834490 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:53.834542 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:53.835044 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:53.835048 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:53.835350 (+ 302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:53.837167 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:53.837168 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:53.837168 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:53.837351 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:53.837607 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:53.837608 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:53.837609 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:53.837670 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:53.837964 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:53.837965 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:53.838001 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 16:42:53.838064 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:42:53.838172 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
I20260811 16:42:53.838302 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.831774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:59555 (local address 127.27.186.126:45757)
0811 16:42:53.831812 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:53.831814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:53.832007 (+ 193us) server_negotiation.cc:407] Connection header received
0811 16:42:53.832044 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:53.832045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:53.832057 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:53.832123 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:53.832494 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.833331 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.834042 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.834392 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.834471 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:53.835441 (+ 970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:53.835442 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:53.835443 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:53.835450 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:53.837054 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:53.837439 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:53.837441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:53.837441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:53.837526 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:53.837743 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:53.837744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:53.837744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:53.837879 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:53.837960 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:53.838119 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 16:42:53.838204 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab.
Entry for principal oryx/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab.
I20260811 16:42:53.856873 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45757
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab
--principal=oryx/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:53.941927 8333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:53.942149 8333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:53.942176 8333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:53.943519 8333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:53.943567 8333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:53.943588 8333 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:53.943606 8333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:53.945088 8333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab
--principal=oryx/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:45757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:53.945286 8333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:53.945505 8333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:53.950749 8345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:53.950748 8348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:53.950845 8340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:53.950878 8333 server_base.cc:1034] running on GCE node
I20260811 16:42:53.951161 8333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:53.951431 8333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:53.952620 8333 hybrid_clock.cc:648] HybridClock initialized: now 1786466573952609 us; error 47 us; skew 500 ppm
Aug 11 16:42:53 dist-test-slave-gsp7 krb5kdc[7915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466573, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:53.955106 8333 init.cc:377] Logged in from keytab as oryx/127.27.186.66@KRBTEST.COM (short username oryx)
I20260811 16:42:53.955605 8333 webserver.cc:460] Webserver started at http://127.27.186.66:41657/ using document root <none> and password file <none>
I20260811 16:42:53.955830 8333 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:53.955900 8333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:53.956046 8333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:53.957125 8333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "edcc9021120f4a52b167ef98eb3cd9e7"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "b7de86408e73cb3c06075c5543e1d2ac"
server_key_iv: "1ee12f477b0e1b472626608e37f0e362"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.957581 8333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "edcc9021120f4a52b167ef98eb3cd9e7"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "b7de86408e73cb3c06075c5543e1d2ac"
server_key_iv: "1ee12f477b0e1b472626608e37f0e362"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.958952 8333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:53.959754 8357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:53.959957 8333 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:53.960064 8333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "edcc9021120f4a52b167ef98eb3cd9e7"
format_stamp: "Formatted at 2026-08-11 16:42:53 on dist-test-slave-gsp7"
server_key: "b7de86408e73cb3c06075c5543e1d2ac"
server_key_iv: "1ee12f477b0e1b472626608e37f0e362"
server_key_version: "encryptionkey@0"
I20260811 16:42:53.960155 8333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:53.983610 8333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:53.985790 8333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:53.985988 8333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:53.986682 8333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:53.986740 8333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:53.986785 8333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:53.986800 8333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:42:53 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466573, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:53.994645 8333 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:34653
I20260811 16:42:53.995086 8333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:53.995064 8535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:34653 every 8 connection(s)
I20260811 16:42:53.997040 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.987213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:54171 (local address 127.27.186.126:45757)
0811 16:42:53.987293 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:53.987296 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:53.987489 (+ 193us) server_negotiation.cc:407] Connection header received
0811 16:42:53.988001 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:53.988003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:53.988016 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:53.988107 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:53.988740 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.989638 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.990732 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.991089 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.991177 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:53.994174 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:53.994175 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:53.994175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:53.994183 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:53.995830 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:53.996257 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:53.996258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:53.996259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:53.996312 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:53.996529 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:53.996529 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:53.996529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:53.996635 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:53.996693 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:53.996905 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 16:42:53.996975 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:42:53.997277 8377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.987165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45757 (local address 127.27.186.66:54171)
0811 16:42:53.987351 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:53.987394 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:53.987904 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:53.988163 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:53.988167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:53.988431 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:53.988623 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:53.988627 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.989764 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.989765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:53.990625 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:53.990628 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:53.991201 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:53.991203 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:53.991354 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:53.991958 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:53.991975 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:53.994056 (+ 2081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:53.995906 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:53.995911 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:53.995934 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:53.996188 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:53.996371 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:53.996372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:53.996372 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:53.996473 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:53.996685 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:53.996687 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:53.996798 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 16:42:53.996875 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:42:53.997001 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260811 16:42:53.997846 8536 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45757
I20260811 16:42:53.997934 8536 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:53.998122 8536 heartbeater.cc:511] Master 127.27.186.126:45757 requested a full tablet report, sending...
I20260811 16:42:53.998530 7984 ts_manager.cc:194] Registered new tserver with Master: edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653)
I20260811 16:42:53.999068 7984 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:54171
I20260811 16:42:54.002782 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 8333
I20260811 16:42:54.002933 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:54.003161 28393 external_mini_cluster.cc:1428] Setting key 9df4ac6aa459e1162c2d767f69cbf886
I20260811 16:42:54.004824 8550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.998869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45757 (local address 127.27.186.66:34511)
0811 16:42:53.999013 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:53.999024 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:53.999088 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:53.999246 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:53.999247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:53.999431 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:53.999504 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:53.999506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.000162 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.000162 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.000722 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.000723 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.001109 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.001110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.001188 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.001689 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:54.001694 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:54.001984 (+ 290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:54.003824 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:54.003825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:54.003825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:54.003996 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:54.004199 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:54.004199 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:54.004200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:54.004245 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:54.004581 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:54.004581 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:54.004619 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.004672 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.004750 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":100,"threads_started":1}
I20260811 16:42:54.004935 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:53.998951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:34511 (local address 127.27.186.126:45757)
0811 16:42:53.998994 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:53.998996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:53.999089 (+ 93us) server_negotiation.cc:407] Connection header received
0811 16:42:53.999160 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:53.999161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:53.999172 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:53.999227 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:53.999593 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.000064 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.000809 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.001018 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.001106 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.002075 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:54.002076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:54.002077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:54.002084 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:54.003684 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.004073 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.004074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.004075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.004136 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.004302 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.004303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.004303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.004510 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:54.004584 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.004720 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.004805 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for oryx/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab.
Entry for principal oryx/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab.
I20260811 16:42:54.032151 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45757
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab
--principal=oryx/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:54.119115 8555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:54.119323 8555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:54.119347 8555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:54.120435 8555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:54.120481 8555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:54.120501 8555 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 16:42:54.120519 8555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:54.122161 8555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab
--principal=oryx/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.27.186.126:45757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:54.122366 8555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:54.122550 8555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:54.127636 8568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:54.127858 8555 server_base.cc:1034] running on GCE node
W20260811 16:42:54.127609 8570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:54.127609 8567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:54.128242 8555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:54.128584 8555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:54.129773 8555 hybrid_clock.cc:648] HybridClock initialized: now 1786466574129766 us; error 35 us; skew 500 ppm
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466574, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:54.132692 8555 init.cc:377] Logged in from keytab as oryx/127.27.186.67@KRBTEST.COM (short username oryx)
I20260811 16:42:54.133162 8555 webserver.cc:460] Webserver started at http://127.27.186.67:38331/ using document root <none> and password file <none>
I20260811 16:42:54.133414 8555 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:54.133502 8555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:54.133680 8555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:54.134863 8555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "2c0c25421db64790bdf1c03b037700e5"
format_stamp: "Formatted at 2026-08-11 16:42:54 on dist-test-slave-gsp7"
server_key: "ea3de2ec8066cb59f7e89d770bcd6c53"
server_key_iv: "f74167179d2934cf1ce02927247b7284"
server_key_version: "encryptionkey@0"
I20260811 16:42:54.135249 8555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "2c0c25421db64790bdf1c03b037700e5"
format_stamp: "Formatted at 2026-08-11 16:42:54 on dist-test-slave-gsp7"
server_key: "ea3de2ec8066cb59f7e89d770bcd6c53"
server_key_iv: "f74167179d2934cf1ce02927247b7284"
server_key_version: "encryptionkey@0"
I20260811 16:42:54.136711 8555 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:54.137612 8583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:54.137805 8555 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:54.137931 8555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "2c0c25421db64790bdf1c03b037700e5"
format_stamp: "Formatted at 2026-08-11 16:42:54 on dist-test-slave-gsp7"
server_key: "ea3de2ec8066cb59f7e89d770bcd6c53"
server_key_iv: "f74167179d2934cf1ce02927247b7284"
server_key_version: "encryptionkey@0"
I20260811 16:42:54.138015 8555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:54.151233 8555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:54.153466 8555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:54.153779 8555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:54.154376 8555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:54.154446 8555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:54.154495 8555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:54.154542 8555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466574, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:54.162609 8555 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:46055
I20260811 16:42:54.162696 8783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:46055 every 8 connection(s)
I20260811 16:42:54.163203 8555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:54.165931 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.154880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:58081 (local address 127.27.186.126:45757)
0811 16:42:54.154960 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.154964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.155151 (+ 187us) server_negotiation.cc:407] Connection header received
0811 16:42:54.155664 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.155665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.155680 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.155759 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:54.156544 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.157368 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.158612 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.158922 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.159000 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.162696 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:54.162698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:54.162698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:54.162707 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:54.164427 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.164852 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.164853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.164854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.164917 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.165196 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.165197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.165197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.165319 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:54.165397 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.165746 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.165839 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:42:54.166118 8599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.154850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45757 (local address 127.27.186.67:58081)
0811 16:42:54.155017 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.155059 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.155562 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.155865 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.155870 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.156169 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:54.156442 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.156450 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.157471 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.157472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.158514 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.158517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.159010 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.159011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.159160 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.159768 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:54.159781 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:54.162559 (+ 2778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:54.164522 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:54.164530 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:54.164532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:54.164757 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:54.165002 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:54.165003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:54.165003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:54.165118 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:54.165388 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:54.165395 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:54.165610 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.165722 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.165886 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260811 16:42:54.166651 8785 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45757
I20260811 16:42:54.166761 8785 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:54.166972 8785 heartbeater.cc:511] Master 127.27.186.126:45757 requested a full tablet report, sending...
I20260811 16:42:54.167389 7983 ts_manager.cc:194] Registered new tserver with Master: 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055)
I20260811 16:42:54.167819 7983 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:58081
I20260811 16:42:54.168135 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 8555
I20260811 16:42:54.168253 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:54.168462 28393 external_mini_cluster.cc:1428] Setting key c017c8c6aa4ce173ddc2b75d21e74679
I20260811 16:42:54.169358 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:42:54.175001 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.168217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:59611 (local address 127.27.186.126:45757)
0811 16:42:54.168259 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.168261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.168717 (+ 456us) server_negotiation.cc:407] Connection header received
0811 16:42:54.168791 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.168792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.168803 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.168849 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:54.169264 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.170100 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.170812 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.171148 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.171226 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.172148 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:54.172149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:54.172149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:54.172156 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:54.173712 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.174106 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.174107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.174108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.174162 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.174422 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.174423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.174424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.174550 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:54.174682 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.174859 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.174933 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:42:54.175058 8795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.168156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45757 (local address 127.27.186.67:59611)
0811 16:42:54.168645 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.168655 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.168733 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.168894 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.168895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.169098 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:54.169166 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.169168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.170203 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.170204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.170716 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.170717 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.171232 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.171233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.171297 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.171777 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:54.171781 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:54.172053 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:54.173790 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:54.173791 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:54.173792 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:54.174029 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:54.174237 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:54.174238 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:54.174239 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:54.174322 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:54.174671 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:54.174672 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:54.174726 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.174813 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.174937 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":79,"threads_started":1}
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466574, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:42:54.194121 8063 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:54.188322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55246 (local address 127.27.186.126:45757)
0811 16:42:54.188391 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.188393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.188404 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:54.188456 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.188457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.188474 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.188543 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:54.189170 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.189741 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.190515 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.190709 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.190786 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.194012 (+ 3226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55246: BlockingRecv error: recv got EOF from 127.0.0.1:55246 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466574, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:54.201740 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.194920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55260 (local address 127.27.186.126:45757)
0811 16:42:54.194997 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.194999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.195078 (+ 79us) server_negotiation.cc:407] Connection header received
0811 16:42:54.195171 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.195172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.195182 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.195251 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:54.195729 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.196188 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.196870 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.197060 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.197150 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.199443 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:54.199444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:54.199445 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:54.199452 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:54.200657 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.200983 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.200984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.200985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.201036 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.201200 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.201201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.201202 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.201308 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:54.201395 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.201613 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.201674 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:42:54.203557 7983 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55260:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:54.205178 7983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:54.211863 8831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.207834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53720 (local address 127.27.186.65:33155)
0811 16:42:54.208037 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.208045 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.208055 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:54.208097 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.208099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.208116 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.208198 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:54.208414 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.209366 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.210817 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.211433 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.211526 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.211620 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.211718 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.211758 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":86,"threads_started":1}
I20260811 16:42:54.211850 8823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.207575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:33155 (local address 127.0.0.1:53720)
0811 16:42:54.207728 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.207774 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.207847 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.208220 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.208224 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.208226 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:54.208293 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.208294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.209452 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.209453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.210713 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.210716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.211526 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.211527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.211607 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.211623 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.211701 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.211757 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":96,"threads_started":1}
I20260811 16:42:54.212312 8822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.207583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:46055 (local address 127.0.0.1:52572)
0811 16:42:54.208014 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.208025 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.208083 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.208521 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.208522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.208524 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:54.208570 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.208571 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.209910 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.209911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.211003 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.211005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.212083 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.212084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.212133 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.212137 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.212167 (+ 30us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.212210 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":3,"thread_start_us":101,"threads_started":1}
I20260811 16:42:54.212384 8828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.207836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53198 (local address 127.27.186.66:34653)
0811 16:42:54.208670 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.208675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.208685 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:54.208730 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.208732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.208747 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.208829 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:54.208968 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.210033 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.211146 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.211859 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.211921 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.212008 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.212223 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.212272 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":790,"thread_start_us":88,"threads_started":1}
I20260811 16:42:54.212882 8827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.207759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52572 (local address 127.27.186.67:46055)
0811 16:42:54.208351 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.208355 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.208365 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:54.208407 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.208410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.208425 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.208529 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:54.208638 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.209808 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.211101 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.211845 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.212587 (+ 742us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.212678 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.212711 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.212750 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":116,"threads_started":1}
I20260811 16:42:54.212790 8199 tablet_service.cc:1467] Processing CreateTablet for tablet 17f0ab16775648e0b9712fb89cf0545c (DEFAULT_TABLE table=test-table [id=1916b87046f84df9a4febc113aa0c1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.212312 8825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.207578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:34653 (local address 127.0.0.1:53198)
0811 16:42:54.207992 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.208002 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.208044 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.208841 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.208842 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.208844 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:54.208879 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.208880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.210121 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.210123 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.211024 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.211027 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.212051 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.212052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.212117 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.212121 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.212183 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.212211 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":1,"thread_start_us":54,"threads_started":1}
I20260811 16:42:54.213230 8199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f0ab16775648e0b9712fb89cf0545c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.213688 8670 tablet_service.cc:1467] Processing CreateTablet for tablet 17f0ab16775648e0b9712fb89cf0545c (DEFAULT_TABLE table=test-table [id=1916b87046f84df9a4febc113aa0c1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.213729 8436 tablet_service.cc:1467] Processing CreateTablet for tablet 17f0ab16775648e0b9712fb89cf0545c (DEFAULT_TABLE table=test-table [id=1916b87046f84df9a4febc113aa0c1ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.214056 8670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f0ab16775648e0b9712fb89cf0545c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.214056 8436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17f0ab16775648e0b9712fb89cf0545c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.216964 8834 tablet_bootstrap.cc:492] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Bootstrap starting.
I20260811 16:42:54.217702 8834 tablet_bootstrap.cc:654] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.217881 8835 tablet_bootstrap.cc:492] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: Bootstrap starting.
I20260811 16:42:54.218190 8836 tablet_bootstrap.cc:492] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Bootstrap starting.
I20260811 16:42:54.218329 8834 log.cc:824] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:54.218587 8835 tablet_bootstrap.cc:654] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.218864 8836 tablet_bootstrap.cc:654] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.218925 8835 log.cc:824] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:54.219218 8836 log.cc:824] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:54.219359 8834 tablet_bootstrap.cc:492] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: No bootstrap required, opened a new log
I20260811 16:42:54.219455 8834 ts_tablet_manager.cc:1397] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:42:54.219776 8835 tablet_bootstrap.cc:492] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: No bootstrap required, opened a new log
I20260811 16:42:54.219851 8835 ts_tablet_manager.cc:1397] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:54.219980 8836 tablet_bootstrap.cc:492] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: No bootstrap required, opened a new log
I20260811 16:42:54.220074 8836 ts_tablet_manager.cc:1397] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:54.221678 8834 raft_consensus.cc:348] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.221868 8834 raft_consensus.cc:374] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.221767 8836 raft_consensus.cc:348] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.221928 8834 raft_consensus.cc:729] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d1fd7ae70d4038aa6234d035c872de, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.221931 8836 raft_consensus.cc:374] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.221971 8836 raft_consensus.cc:729] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc9021120f4a52b167ef98eb3cd9e7, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.221959 8835 raft_consensus.cc:348] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.222118 8835 raft_consensus.cc:374] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.222071 8834 consensus_queue.cc:260] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.222093 8836 consensus_queue.cc:260] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.222160 8835 raft_consensus.cc:729] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0c25421db64790bdf1c03b037700e5, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.222294 8835 consensus_queue.cc:260] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.222352 8834 ts_tablet_manager.cc:1428] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:42:54.222352 8836 ts_tablet_manager.cc:1428] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:42:54.222506 8536 heartbeater.cc:503] Master 127.27.186.126:45757 was elected leader, sending a full tablet report...
I20260811 16:42:54.222572 8835 ts_tablet_manager.cc:1428] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:42:54.222703 8785 heartbeater.cc:503] Master 127.27.186.126:45757 was elected leader, sending a full tablet report...
I20260811 16:42:54.222800 8310 heartbeater.cc:503] Master 127.27.186.126:45757 was elected leader, sending a full tablet report...
W20260811 16:42:54.245802 8540 tablet.cc:2369] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:54.300441 8849 raft_consensus.cc:482] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:54.300595 8849 raft_consensus.cc:504] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.300920 8849 leader_election.cc:288] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155), edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653)
I20260811 16:42:54.304137 8828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.301259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:51771 (local address 127.27.186.66:34653)
0811 16:42:54.301317 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.301319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.301330 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:42:54.301402 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.301403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.301412 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.301522 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:54.301703 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.302428 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.303362 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.303747 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.303832 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.303841 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.304015 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.304053 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:42:54.304137 8599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.301158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:34653 (local address 127.27.186.67:51771)
0811 16:42:54.301225 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.301239 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.301325 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.301542 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.301543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.301545 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:54.301627 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.301628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.302505 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.302507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.303258 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.303261 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.303842 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.303844 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.303935 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.303938 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.304007 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.304052 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 16:42:54.304220 8831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.301283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:49865 (local address 127.27.186.65:33155)
0811 16:42:54.301329 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.301331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.301492 (+ 161us) server_negotiation.cc:407] Connection header received
0811 16:42:54.301623 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.301624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.301632 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.301699 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:54.301878 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.302541 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.303469 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.303847 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.303934 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.303943 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.304104 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.304148 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:42:54.304263 8850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.301159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:33155 (local address 127.27.186.67:49865)
0811 16:42:54.301389 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.301403 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.301538 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.301704 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.301705 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.301707 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:54.301805 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.301806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.302621 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.302622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.303374 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.303376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.303935 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.303936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.304010 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.304015 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.304084 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.304132 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":47,"thread_start_us":118,"threads_started":1}
I20260811 16:42:54.304579 8238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f0ab16775648e0b9712fb89cf0545c" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d1fd7ae70d4038aa6234d035c872de" is_pre_election: true
I20260811 16:42:54.304579 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f0ab16775648e0b9712fb89cf0545c" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" is_pre_election: true
I20260811 16:42:54.304749 8238 raft_consensus.cc:2454] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 0.
I20260811 16:42:54.304749 8457 raft_consensus.cc:2454] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 0.
I20260811 16:42:54.304989 8586 leader_election.cc:302] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0c25421db64790bdf1c03b037700e5, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:54.305136 8849 raft_consensus.cc:2781] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:54.305226 8849 raft_consensus.cc:482] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:54.305262 8849 raft_consensus.cc:3037] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.306272 8849 raft_consensus.cc:504] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.306435 8849 leader_election.cc:288] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 election: Requested vote from peers f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155), edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653)
I20260811 16:42:54.306630 8238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f0ab16775648e0b9712fb89cf0545c" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d1fd7ae70d4038aa6234d035c872de"
I20260811 16:42:54.306682 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17f0ab16775648e0b9712fb89cf0545c" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7"
I20260811 16:42:54.306740 8238 raft_consensus.cc:3037] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.306751 8457 raft_consensus.cc:3037] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.307660 8238 raft_consensus.cc:2454] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 1.
I20260811 16:42:54.307660 8457 raft_consensus.cc:2454] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 1.
I20260811 16:42:54.307861 8593 leader_election.cc:302] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0c25421db64790bdf1c03b037700e5, edcc9021120f4a52b167ef98eb3cd9e7; no voters:
I20260811 16:42:54.307963 8849 raft_consensus.cc:2781] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:54.308123 8849 raft_consensus.cc:686] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2c0c25421db64790bdf1c03b037700e5, State: Running, Role: LEADER
I20260811 16:42:54.308240 8849 consensus_queue.cc:237] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } }
I20260811 16:42:54.309249 7981 catalog_manager.cc:5495] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67). New cstate: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } health_report { overall_health: UNKNOWN } } }
W20260811 16:42:54.327080 8311 tablet.cc:2369] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:54.329913 8827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.327601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52580 (local address 127.27.186.67:46055)
0811 16:42:54.327662 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.327664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.327673 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:54.327720 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.327721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.327739 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.327803 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:54.327941 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.328408 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.329138 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.329383 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.329438 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.329643 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:54.329737 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:54.329800 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.329838 (+ 38us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.329856 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:42:54.332016 8238 raft_consensus.cc:1261] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Refusing update from remote peer 2c0c25421db64790bdf1c03b037700e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:54.332016 8457 raft_consensus.cc:1261] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Refusing update from remote peer 2c0c25421db64790bdf1c03b037700e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:54.332388 8851 consensus_queue.cc:1035] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:54.332552 8849 consensus_queue.cc:1035] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:54.335003 8855 mvcc.cc:205] Tried to move back new op lower bound from 7317367088460599296 to 7317367088367333376. Current Snapshot: MvccSnapshot[applied={T|T < 7317367088460599296}]
I20260811 16:42:54.335366 8856 mvcc.cc:205] Tried to move back new op lower bound from 7317367088460599296 to 7317367088367333376. Current Snapshot: MvccSnapshot[applied={T|T < 7317367088460599296}]
I20260811 16:42:54.337090 7981 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:54.337193 7981 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:54.337966 7981 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: Sending DeleteTablet for 3 replicas of tablet 17f0ab16775648e0b9712fb89cf0545c
I20260811 16:42:54.338299 8670 tablet_service.cc:1514] Processing DeleteTablet for tablet 17f0ab16775648e0b9712fb89cf0545c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:54 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:52572
I20260811 16:42:54.338312 8199 tablet_service.cc:1514] Processing DeleteTablet for tablet 17f0ab16775648e0b9712fb89cf0545c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:54 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:53720
I20260811 16:42:54.338537 8868 tablet_replica.cc:330] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: stopping tablet replica
I20260811 16:42:54.338649 8868 raft_consensus.cc:2229] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:54.338761 8868 raft_consensus.cc:2258] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:54.338817 8436 tablet_service.cc:1514] Processing DeleteTablet for tablet 17f0ab16775648e0b9712fb89cf0545c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:54 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:53198
I20260811 16:42:54.339260 8868 ts_tablet_manager.cc:1905] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:54.339267 7981 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55260:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:54.339406 7981 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:54.339707 8867 tablet_replica.cc:330] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: stopping tablet replica
I20260811 16:42:54.339816 8867 raft_consensus.cc:2229] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:54.339923 8867 raft_consensus.cc:2258] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:54.340204 8869 tablet_replica.cc:330] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: stopping tablet replica
I20260811 16:42:54.340361 8869 raft_consensus.cc:2229] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:54.340493 8869 raft_consensus.cc:2258] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:54.340860 8670 tablet_service.cc:1467] Processing CreateTablet for tablet d33871b7a22e4e9f94a18a3980b0ca3d (DEFAULT_TABLE table=test-table [id=f5c28fc454114e0cb6418130bb8cc678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.340920 8867 ts_tablet_manager.cc:1905] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:54.340986 8670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d33871b7a22e4e9f94a18a3980b0ca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.342479 8835 tablet_bootstrap.cc:492] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: Bootstrap starting.
I20260811 16:42:54.342581 8869 ts_tablet_manager.cc:1905] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:54.342821 8436 tablet_service.cc:1467] Processing CreateTablet for tablet d33871b7a22e4e9f94a18a3980b0ca3d (DEFAULT_TABLE table=test-table [id=f5c28fc454114e0cb6418130bb8cc678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.342924 8436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d33871b7a22e4e9f94a18a3980b0ca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.343001 8835 tablet_bootstrap.cc:654] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.344182 8836 tablet_bootstrap.cc:492] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: Bootstrap starting.
I20260811 16:42:54.344357 8869 ts_tablet_manager.cc:1918] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:54.344394 8867 ts_tablet_manager.cc:1918] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:54.344473 8867 log.cc:1196] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/17f0ab16775648e0b9712fb89cf0545c
I20260811 16:42:54.344579 8869 log.cc:1196] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/17f0ab16775648e0b9712fb89cf0545c
I20260811 16:42:54.344650 8836 tablet_bootstrap.cc:654] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.344764 8867 ts_tablet_manager.cc:1939] T 17f0ab16775648e0b9712fb89cf0545c P 2c0c25421db64790bdf1c03b037700e5: Deleting consensus metadata
I20260811 16:42:54.344976 8199 tablet_service.cc:1467] Processing CreateTablet for tablet d33871b7a22e4e9f94a18a3980b0ca3d (DEFAULT_TABLE table=test-table [id=f5c28fc454114e0cb6418130bb8cc678]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.345104 8199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d33871b7a22e4e9f94a18a3980b0ca3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.345191 7958 catalog_manager.cc:4841] TS 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055): tablet 17f0ab16775648e0b9712fb89cf0545c (table test-table [id=1916b87046f84df9a4febc113aa0c1ad]) successfully deleted
I20260811 16:42:54.345414 8869 ts_tablet_manager.cc:1939] T 17f0ab16775648e0b9712fb89cf0545c P edcc9021120f4a52b167ef98eb3cd9e7: Deleting consensus metadata
I20260811 16:42:54.345960 7960 catalog_manager.cc:4841] TS edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653): tablet 17f0ab16775648e0b9712fb89cf0545c (table test-table [id=1916b87046f84df9a4febc113aa0c1ad]) successfully deleted
I20260811 16:42:54.346347 8834 tablet_bootstrap.cc:492] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: Bootstrap starting.
I20260811 16:42:54.346750 8834 tablet_bootstrap.cc:654] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.347433 8834 tablet_bootstrap.cc:492] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: No bootstrap required, opened a new log
I20260811 16:42:54.347486 8834 ts_tablet_manager.cc:1397] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:54.347847 8834 raft_consensus.cc:348] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.347939 8868 ts_tablet_manager.cc:1918] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:54.347947 8834 raft_consensus.cc:374] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.348011 8834 raft_consensus.cc:729] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d1fd7ae70d4038aa6234d035c872de, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.348037 8868 log.cc:1196] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/17f0ab16775648e0b9712fb89cf0545c
I20260811 16:42:54.348060 8834 consensus_queue.cc:260] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.348206 8834 ts_tablet_manager.cc:1428] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:54.348320 8868 ts_tablet_manager.cc:1939] T 17f0ab16775648e0b9712fb89cf0545c P f3d1fd7ae70d4038aa6234d035c872de: Deleting consensus metadata
I20260811 16:42:54.348743 7957 catalog_manager.cc:4841] TS f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155): tablet 17f0ab16775648e0b9712fb89cf0545c (table test-table [id=1916b87046f84df9a4febc113aa0c1ad]) successfully deleted
I20260811 16:42:54.349321 8835 tablet_bootstrap.cc:492] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: No bootstrap required, opened a new log
I20260811 16:42:54.349320 8836 tablet_bootstrap.cc:492] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: No bootstrap required, opened a new log
I20260811 16:42:54.349395 8836 ts_tablet_manager.cc:1397] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 16:42:54.349396 8835 ts_tablet_manager.cc:1397] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260811 16:42:54.349597 8835 raft_consensus.cc:348] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.349592 8836 raft_consensus.cc:348] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.349685 8836 raft_consensus.cc:374] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.349685 8835 raft_consensus.cc:374] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.349709 8836 raft_consensus.cc:729] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc9021120f4a52b167ef98eb3cd9e7, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.349713 8835 raft_consensus.cc:729] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0c25421db64790bdf1c03b037700e5, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.349756 8836 consensus_queue.cc:260] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.349759 8835 consensus_queue.cc:260] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.349848 8836 ts_tablet_manager.cc:1428] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:54.349852 8835 ts_tablet_manager.cc:1428] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260811 16:42:54.413836 8788 tablet.cc:2369] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:42:54.625375 8843 raft_consensus.cc:482] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:54.625535 8843 raft_consensus.cc:504] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.625969 8843 leader_election.cc:288] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653), 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055)
I20260811 16:42:54.627099 8849 raft_consensus.cc:482] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:54.627192 8849 raft_consensus.cc:504] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.627329 8849 leader_election.cc:288] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155), edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653)
I20260811 16:42:54.627493 8238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33871b7a22e4e9f94a18a3980b0ca3d" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d1fd7ae70d4038aa6234d035c872de" is_pre_election: true
I20260811 16:42:54.627586 8238 raft_consensus.cc:2454] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 0.
I20260811 16:42:54.627593 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33871b7a22e4e9f94a18a3980b0ca3d" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" is_pre_election: true
I20260811 16:42:54.627708 8457 raft_consensus.cc:2454] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 0.
I20260811 16:42:54.627733 8586 leader_election.cc:302] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0c25421db64790bdf1c03b037700e5, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:54.627820 8849 raft_consensus.cc:2781] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:54.627848 8849 raft_consensus.cc:482] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:54.627866 8849 raft_consensus.cc:3037] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.628790 8849 raft_consensus.cc:504] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.628950 8849 leader_election.cc:288] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 election: Requested vote from peers f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155), edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653)
I20260811 16:42:54.629139 8238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33871b7a22e4e9f94a18a3980b0ca3d" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d1fd7ae70d4038aa6234d035c872de"
I20260811 16:42:54.629206 8238 raft_consensus.cc:3037] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.629189 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33871b7a22e4e9f94a18a3980b0ca3d" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7"
I20260811 16:42:54.629261 8457 raft_consensus.cc:3037] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.630034 8238 raft_consensus.cc:2454] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 1.
I20260811 16:42:54.630034 8457 raft_consensus.cc:2454] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 1.
I20260811 16:42:54.630091 8827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.626304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:42389 (local address 127.27.186.67:46055)
0811 16:42:54.626382 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.626384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.626470 (+ 86us) server_negotiation.cc:407] Connection header received
0811 16:42:54.626535 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.626536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.626547 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.626624 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:54.626800 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.627418 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.628970 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.629577 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.629647 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.629656 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.629937 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.629985 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 16:42:54.630237 8586 leader_election.cc:302] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0c25421db64790bdf1c03b037700e5, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:54.630254 8828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.626351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:39013 (local address 127.27.186.66:34653)
0811 16:42:54.626410 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.626412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.626426 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:42:54.626534 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.626536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.626546 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.626621 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:42:54.626809 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.627516 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.629178 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.629802 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.629848 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.629855 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.630106 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.630156 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:42:54.630342 8849 raft_consensus.cc:2781] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:54.630386 8849 raft_consensus.cc:686] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2c0c25421db64790bdf1c03b037700e5, State: Running, Role: LEADER
I20260811 16:42:54.630436 8849 consensus_queue.cc:237] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.630486 8878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.626218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:46055 (local address 127.27.186.65:42389)
0811 16:42:54.626392 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.626403 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.626473 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.626627 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.626628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.626630 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:54.626723 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.626725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.627524 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.627525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.628811 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.628814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.629751 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.629753 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.629831 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.629836 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.630228 (+ 392us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.630276 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":4,"thread_start_us":75,"threads_started":1}
I20260811 16:42:54.630501 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.626217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:34653 (local address 127.27.186.65:39013)
0811 16:42:54.626367 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.626380 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.626446 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.626626 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.626627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.626629 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:42:54.626724 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.626726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.627609 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.627610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.629056 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.629059 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.629915 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.629915 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.629978 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.629981 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.630384 (+ 403us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.630424 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260811 16:42:54.630800 8699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33871b7a22e4e9f94a18a3980b0ca3d" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0c25421db64790bdf1c03b037700e5" is_pre_election: true
I20260811 16:42:54.631014 7983 catalog_manager.cc:5495] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67). New cstate: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } health_report { overall_health: HEALTHY } } }
I20260811 16:42:54.631098 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33871b7a22e4e9f94a18a3980b0ca3d" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" is_pre_election: true
I20260811 16:42:54.631183 8457 raft_consensus.cc:2379] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3d1fd7ae70d4038aa6234d035c872de in current term 1: Already voted for candidate 2c0c25421db64790bdf1c03b037700e5 in this term.
I20260811 16:42:54.631366 8130 leader_election.cc:302] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3d1fd7ae70d4038aa6234d035c872de; no voters: 2c0c25421db64790bdf1c03b037700e5, edcc9021120f4a52b167ef98eb3cd9e7
I20260811 16:42:54.631614 8843 raft_consensus.cc:2726] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466573, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.126@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:54.723049 8892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.714139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45757 (local address 127.0.0.1:55268)
0811 16:42:54.714312 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.714324 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.714397 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.714543 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.714543 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.714880 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:54.714939 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.714941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.715684 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.715685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.716333 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.716335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.716739 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.716764 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.716831 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.717509 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:54.717515 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:54.719635 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:54.721784 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:54.721794 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:54.721796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:54.722028 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:54.722257 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:54.722258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:54.722258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:54.722320 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:54.722645 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:54.722656 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:54.722759 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.722864 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.722968 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
I20260811 16:42:54.723205 8893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.714235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55268 (local address 127.27.186.126:45757)
0811 16:42:54.714325 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.714327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.714393 (+ 66us) server_negotiation.cc:407] Connection header received
0811 16:42:54.714441 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.714442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.714452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.714525 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:54.715040 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.715608 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.716403 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.716645 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.716719 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.719754 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:54.719756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:54.719757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:54.719765 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:54.721694 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.722122 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.722123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.722124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.722190 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.722386 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.722387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.722387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.722535 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:54.722607 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.722924 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.723080 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":62,"thread_start_us":43,"threads_started":1}
I20260811 16:42:54.725370 7983 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:55268:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 16:42:54.725641 7983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:54.727209 8670 tablet_service.cc:1467] Processing CreateTablet for tablet 5e9620b64a46497ab1edb0ca7ede0d02 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8fb04c31052243b9beae560fc3130cf9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:54.727240 8199 tablet_service.cc:1467] Processing CreateTablet for tablet 5e9620b64a46497ab1edb0ca7ede0d02 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8fb04c31052243b9beae560fc3130cf9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:54.727382 8670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e9620b64a46497ab1edb0ca7ede0d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.727402 8199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e9620b64a46497ab1edb0ca7ede0d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.728804 8834 tablet_bootstrap.cc:492] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: Bootstrap starting.
I20260811 16:42:54.728814 8835 tablet_bootstrap.cc:492] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: Bootstrap starting.
I20260811 16:42:54.728915 8436 tablet_service.cc:1467] Processing CreateTablet for tablet 5e9620b64a46497ab1edb0ca7ede0d02 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8fb04c31052243b9beae560fc3130cf9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 16:42:54.729080 8436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e9620b64a46497ab1edb0ca7ede0d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.729126 8835 tablet_bootstrap.cc:654] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.729250 8834 tablet_bootstrap.cc:654] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.729743 8835 tablet_bootstrap.cc:492] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: No bootstrap required, opened a new log
I20260811 16:42:54.729799 8835 ts_tablet_manager.cc:1397] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:54.729933 8835 raft_consensus.cc:348] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.730029 8835 raft_consensus.cc:374] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.730062 8835 raft_consensus.cc:729] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0c25421db64790bdf1c03b037700e5, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.730116 8835 consensus_queue.cc:260] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.730214 8835 ts_tablet_manager.cc:1428] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:54.730247 8849 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.730367 8849 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:54.730855 8836 tablet_bootstrap.cc:492] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: Bootstrap starting.
I20260811 16:42:54.731208 8834 tablet_bootstrap.cc:492] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: No bootstrap required, opened a new log
I20260811 16:42:54.731252 8834 ts_tablet_manager.cc:1397] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:54.731284 8836 tablet_bootstrap.cc:654] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.731362 8834 raft_consensus.cc:348] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.731410 8834 raft_consensus.cc:374] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.731464 8834 raft_consensus.cc:729] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d1fd7ae70d4038aa6234d035c872de, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.731516 8834 consensus_queue.cc:260] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.731627 8834 ts_tablet_manager.cc:1428] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:54.731673 8843 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.731769 8843 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:54.732023 8836 tablet_bootstrap.cc:492] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: No bootstrap required, opened a new log
I20260811 16:42:54.732066 8836 ts_tablet_manager.cc:1397] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 16:42:54.732246 8836 raft_consensus.cc:348] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.732301 8836 raft_consensus.cc:374] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.732316 8836 raft_consensus.cc:729] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc9021120f4a52b167ef98eb3cd9e7, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.732345 8836 consensus_queue.cc:260] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.732465 8836 ts_tablet_manager.cc:1428] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:54.732514 8848 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.732592 8848 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:54.835608 8849 raft_consensus.cc:482] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:54.835734 8849 raft_consensus.cc:504] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.835968 8849 leader_election.cc:288] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155), edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653)
I20260811 16:42:54.836198 8238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9620b64a46497ab1edb0ca7ede0d02" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d1fd7ae70d4038aa6234d035c872de" is_pre_election: true
I20260811 16:42:54.836246 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9620b64a46497ab1edb0ca7ede0d02" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" is_pre_election: true
I20260811 16:42:54.836314 8238 raft_consensus.cc:2454] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 0.
I20260811 16:42:54.836333 8457 raft_consensus.cc:2454] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 0.
I20260811 16:42:54.836513 8586 leader_election.cc:302] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0c25421db64790bdf1c03b037700e5, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:54.836649 8849 raft_consensus.cc:2781] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:54.836699 8849 raft_consensus.cc:482] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:54.836714 8849 raft_consensus.cc:3037] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.837399 8849 raft_consensus.cc:504] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.837611 8849 leader_election.cc:288] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 election: Requested vote from peers f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155), edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653)
I20260811 16:42:54.837774 8238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9620b64a46497ab1edb0ca7ede0d02" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3d1fd7ae70d4038aa6234d035c872de"
I20260811 16:42:54.837862 8238 raft_consensus.cc:3037] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.837811 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e9620b64a46497ab1edb0ca7ede0d02" candidate_uuid: "2c0c25421db64790bdf1c03b037700e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7"
I20260811 16:42:54.837927 8457 raft_consensus.cc:3037] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:54.838469 8238 raft_consensus.cc:2454] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 1.
I20260811 16:42:54.838640 8457 raft_consensus.cc:2454] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c0c25421db64790bdf1c03b037700e5 in term 1.
I20260811 16:42:54.838662 8586 leader_election.cc:302] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0c25421db64790bdf1c03b037700e5, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:54.838748 8849 raft_consensus.cc:2781] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:54.838792 8849 raft_consensus.cc:686] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2c0c25421db64790bdf1c03b037700e5, State: Running, Role: LEADER
I20260811 16:42:54.838847 8849 consensus_queue.cc:237] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.839166 8849 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: TxnStatusTablet state changed. Reason: New leader 2c0c25421db64790bdf1c03b037700e5. Latest consensus state: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.839241 8849 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:54.839496 8899 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 16:42:54.839529 7983 catalog_manager.cc:5495] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67). New cstate: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } health_report { overall_health: HEALTHY } } }
I20260811 16:42:54.839643 8899 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 16:42:54.847947 8827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.845319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52584 (local address 127.27.186.67:46055)
0811 16:42:54.845364 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.845366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.845397 (+ 31us) server_negotiation.cc:407] Connection header received
0811 16:42:54.845510 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.845511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.845523 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.845583 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:54.845733 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.846186 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.847306 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.847490 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.847536 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.847747 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:54.847775 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:54.847805 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.847875 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.847893 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:42:54.848215 8892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.845232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:46055 (local address 127.0.0.1:52584)
0811 16:42:54.845337 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.845351 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.845419 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.845610 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.845611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.845613 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:54.845667 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.845669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.846265 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.846266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.847211 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.847214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.847562 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.847563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.847636 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.847656 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:54.847818 (+ 162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:54.847824 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.847873 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.847930 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 16:42:54.849366 8238 raft_consensus.cc:1261] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Refusing update from remote peer 2c0c25421db64790bdf1c03b037700e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:54.849391 8457 raft_consensus.cc:1261] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Refusing update from remote peer 2c0c25421db64790bdf1c03b037700e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:54.849622 8849 consensus_queue.cc:1035] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:54.849710 8851 consensus_queue.cc:1035] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:54.850162 8843 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: TxnStatusTablet state changed. Reason: New leader 2c0c25421db64790bdf1c03b037700e5. Latest consensus state: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.850262 8843 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:54.850212 8848 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: TxnStatusTablet state changed. Reason: New leader 2c0c25421db64790bdf1c03b037700e5. Latest consensus state: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.850289 8848 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:54.851106 8849 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.851116 8851 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.851197 8849 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:54.851238 8851 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P 2c0c25421db64790bdf1c03b037700e5: This TxnStatusTablet replica's current role is: LEADER
I20260811 16:42:54.851526 8848 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.851619 8848 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P edcc9021120f4a52b167ef98eb3cd9e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:54.851961 8843 tablet_replica.cc:439] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2c0c25421db64790bdf1c03b037700e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } } }
I20260811 16:42:54.852044 8843 tablet_replica.cc:442] T 5e9620b64a46497ab1edb0ca7ede0d02 P f3d1fd7ae70d4038aa6234d035c872de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 16:42:54.858107 8930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.855299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:46055 (local address 127.27.186.67:40955)
0811 16:42:54.855453 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:54.855465 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:54.855544 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:54.855663 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:54.855664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:54.855666 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:54.855715 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.855717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.856280 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.856281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.857208 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:54.857210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.857586 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.857587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:54.857650 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.857669 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:54.857867 (+ 198us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:54.857870 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:54.857918 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:42:54.857988 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":5,"thread_start_us":93,"threads_started":1}
I20260811 16:42:54.858119 8827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.855383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:40955 (local address 127.27.186.67:46055)
0811 16:42:54.855431 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.855433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.855528 (+ 95us) server_negotiation.cc:407] Connection header received
0811 16:42:54.855602 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.855603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.855611 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.855655 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:54.855770 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.856208 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.857297 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.857519 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.857589 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.857759 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:54.857793 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:54.857850 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.857920 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.857956 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":25}
I20260811 16:42:54.870471 8457 raft_consensus.cc:1261] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Refusing update from remote peer 2c0c25421db64790bdf1c03b037700e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:54.870559 8238 raft_consensus.cc:1261] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Refusing update from remote peer 2c0c25421db64790bdf1c03b037700e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:54.870715 8851 consensus_queue.cc:1035] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:54.870852 8851 consensus_queue.cc:1035] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:54.874490 8911 mvcc.cc:205] Tried to move back new op lower bound from 7317367090667917312 to 7317367089686573056. Current Snapshot: MvccSnapshot[applied={T|T < 7317367090667917312}]
I20260811 16:42:54.890415 7983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:54.890537 7983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:54.891166 7983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: Sending DeleteTablet for 3 replicas of tablet d33871b7a22e4e9f94a18a3980b0ca3d
I20260811 16:42:54.891398 8199 tablet_service.cc:1514] Processing DeleteTablet for tablet d33871b7a22e4e9f94a18a3980b0ca3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:54 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:53720
I20260811 16:42:54.891445 8667 tablet_service.cc:1514] Processing DeleteTablet for tablet d33871b7a22e4e9f94a18a3980b0ca3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:54 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:52572
I20260811 16:42:54.891474 8436 tablet_service.cc:1514] Processing DeleteTablet for tablet d33871b7a22e4e9f94a18a3980b0ca3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:54 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:53198
I20260811 16:42:54.897655 8936 tablet_replica.cc:330] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: stopping tablet replica
I20260811 16:42:54.897748 8936 raft_consensus.cc:2229] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:54.897835 8936 raft_consensus.cc:2258] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:54.897958 8938 tablet_replica.cc:330] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: stopping tablet replica
I20260811 16:42:54.898029 8938 raft_consensus.cc:2229] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:54.898087 8938 raft_consensus.cc:2258] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:54.898221 8939 tablet_replica.cc:330] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: stopping tablet replica
I20260811 16:42:54.898295 8939 raft_consensus.cc:2229] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:54.898350 8939 raft_consensus.cc:2258] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:54.898413 8936 ts_tablet_manager.cc:1905] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:54.898851 8939 ts_tablet_manager.cc:1905] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:54.899979 8938 ts_tablet_manager.cc:1905] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:54.900485 8936 ts_tablet_manager.cc:1918] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:54.900600 8936 log.cc:1196] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/d33871b7a22e4e9f94a18a3980b0ca3d
I20260811 16:42:54.900969 8936 ts_tablet_manager.cc:1939] T d33871b7a22e4e9f94a18a3980b0ca3d P 2c0c25421db64790bdf1c03b037700e5: Deleting consensus metadata
I20260811 16:42:54.901382 7958 catalog_manager.cc:4841] TS 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055): tablet d33871b7a22e4e9f94a18a3980b0ca3d (table test-table [id=f5c28fc454114e0cb6418130bb8cc678]) successfully deleted
I20260811 16:42:54.902412 8939 ts_tablet_manager.cc:1918] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:54.902501 8939 log.cc:1196] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/d33871b7a22e4e9f94a18a3980b0ca3d
I20260811 16:42:54.902769 8939 ts_tablet_manager.cc:1939] T d33871b7a22e4e9f94a18a3980b0ca3d P edcc9021120f4a52b167ef98eb3cd9e7: Deleting consensus metadata
I20260811 16:42:54.903239 7960 catalog_manager.cc:4841] TS edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653): tablet d33871b7a22e4e9f94a18a3980b0ca3d (table test-table [id=f5c28fc454114e0cb6418130bb8cc678]) successfully deleted
I20260811 16:42:54.904045 8938 ts_tablet_manager.cc:1918] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:54.904121 8938 log.cc:1196] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/d33871b7a22e4e9f94a18a3980b0ca3d
I20260811 16:42:54.904356 8938 ts_tablet_manager.cc:1939] T d33871b7a22e4e9f94a18a3980b0ca3d P f3d1fd7ae70d4038aa6234d035c872de: Deleting consensus metadata
I20260811 16:42:54.904778 7957 catalog_manager.cc:4841] TS f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155): tablet d33871b7a22e4e9f94a18a3980b0ca3d (table test-table [id=f5c28fc454114e0cb6418130bb8cc678]) successfully deleted
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:42:54.930254 8893 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:54.922523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55270 (local address 127.27.186.126:45757)
0811 16:42:54.922594 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.922597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.922846 (+ 249us) server_negotiation.cc:407] Connection header received
0811 16:42:54.922934 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.922936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.922951 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.923022 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:54.923751 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.924756 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.925847 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.926248 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.926334 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.930154 (+ 3820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55270: BlockingRecv error: recv got EOF from 127.0.0.1:55270 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:42:54 dist-test-slave-gsp7 krb5kdc[7915](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM
I20260811 16:42:54.944018 8893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:54.933792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55280 (local address 127.27.186.126:45757)
0811 16:42:54.933838 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:54.933840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:54.934010 (+ 170us) server_negotiation.cc:407] Connection header received
0811 16:42:54.934044 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:54.934045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:54.934060 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:54.934125 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:54.934823 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.935543 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.936763 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:54.937067 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:54.937151 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:54.940282 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:54.940284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:54.940285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:54.940294 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:54.942427 (+ 2133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.942950 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.942951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.942952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.943022 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:54.943280 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:54.943281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:54.943281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:54.943462 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:54.943581 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:54.943766 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 16:42:54.943873 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:42:54.946082 7983 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55280:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:54.946282 7983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:54.947830 8667 tablet_service.cc:1467] Processing CreateTablet for tablet d840eed4b60f40c681499938a719bcbf (DEFAULT_TABLE table=test-table [id=917adf7c48ff4ac1af4effa420fb55e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.947836 8436 tablet_service.cc:1467] Processing CreateTablet for tablet d840eed4b60f40c681499938a719bcbf (DEFAULT_TABLE table=test-table [id=917adf7c48ff4ac1af4effa420fb55e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.947988 8436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d840eed4b60f40c681499938a719bcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.947989 8667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d840eed4b60f40c681499938a719bcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.949455 8836 tablet_bootstrap.cc:492] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: Bootstrap starting.
I20260811 16:42:54.949806 8835 tablet_bootstrap.cc:492] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: Bootstrap starting.
I20260811 16:42:54.950048 8836 tablet_bootstrap.cc:654] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.950168 8835 tablet_bootstrap.cc:654] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.951063 8199 tablet_service.cc:1467] Processing CreateTablet for tablet d840eed4b60f40c681499938a719bcbf (DEFAULT_TABLE table=test-table [id=917adf7c48ff4ac1af4effa420fb55e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:54.951206 8199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d840eed4b60f40c681499938a719bcbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:54.952605 8834 tablet_bootstrap.cc:492] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: Bootstrap starting.
I20260811 16:42:54.952973 8836 tablet_bootstrap.cc:492] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: No bootstrap required, opened a new log
I20260811 16:42:54.953019 8836 ts_tablet_manager.cc:1397] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 16:42:54.953172 8836 raft_consensus.cc:348] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.953245 8836 raft_consensus.cc:374] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.953266 8836 raft_consensus.cc:729] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc9021120f4a52b167ef98eb3cd9e7, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.953313 8836 consensus_queue.cc:260] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.953336 8834 tablet_bootstrap.cc:654] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:54.953408 8836 ts_tablet_manager.cc:1428] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:54.954232 8834 tablet_bootstrap.cc:492] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: No bootstrap required, opened a new log
I20260811 16:42:54.954288 8834 ts_tablet_manager.cc:1397] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:42:54.954489 8834 raft_consensus.cc:348] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.954568 8834 raft_consensus.cc:374] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.954593 8834 raft_consensus.cc:729] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d1fd7ae70d4038aa6234d035c872de, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.954648 8834 consensus_queue.cc:260] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.954751 8834 ts_tablet_manager.cc:1428] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:54.957873 8835 tablet_bootstrap.cc:492] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: No bootstrap required, opened a new log
I20260811 16:42:54.957937 8835 ts_tablet_manager.cc:1397] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260811 16:42:54.958065 8835 raft_consensus.cc:348] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.958146 8835 raft_consensus.cc:374] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:54.958169 8835 raft_consensus.cc:729] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0c25421db64790bdf1c03b037700e5, State: Initialized, Role: FOLLOWER
I20260811 16:42:54.958221 8835 consensus_queue.cc:260] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:54.958326 8835 ts_tablet_manager.cc:1428] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:55.145337 8843 raft_consensus.cc:482] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:55.145536 8843 raft_consensus.cc:504] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.145759 8843 leader_election.cc:288] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653), 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055)
I20260811 16:42:55.146015 8699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d840eed4b60f40c681499938a719bcbf" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0c25421db64790bdf1c03b037700e5" is_pre_election: true
I20260811 16:42:55.146020 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d840eed4b60f40c681499938a719bcbf" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" is_pre_election: true
I20260811 16:42:55.146127 8699 raft_consensus.cc:2454] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d1fd7ae70d4038aa6234d035c872de in term 0.
I20260811 16:42:55.146158 8457 raft_consensus.cc:2454] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d1fd7ae70d4038aa6234d035c872de in term 0.
I20260811 16:42:55.146335 8128 leader_election.cc:302] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0c25421db64790bdf1c03b037700e5, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:55.146448 8843 raft_consensus.cc:2781] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:55.146487 8843 raft_consensus.cc:482] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:55.146507 8843 raft_consensus.cc:3037] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:55.147284 8843 raft_consensus.cc:504] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.147439 8843 leader_election.cc:288] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 election: Requested vote from peers edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653), 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055)
I20260811 16:42:55.147648 8699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d840eed4b60f40c681499938a719bcbf" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0c25421db64790bdf1c03b037700e5"
I20260811 16:42:55.147682 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d840eed4b60f40c681499938a719bcbf" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7"
I20260811 16:42:55.147745 8699 raft_consensus.cc:3037] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:55.147754 8457 raft_consensus.cc:3037] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:55.148582 8457 raft_consensus.cc:2454] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d1fd7ae70d4038aa6234d035c872de in term 1.
I20260811 16:42:55.148661 8699 raft_consensus.cc:2454] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d1fd7ae70d4038aa6234d035c872de in term 1.
I20260811 16:42:55.148808 8130 leader_election.cc:302] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcc9021120f4a52b167ef98eb3cd9e7, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:55.148898 8843 raft_consensus.cc:2781] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:55.149056 8843 raft_consensus.cc:686] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 1 LEADER]: Becoming Leader. State: Replica: f3d1fd7ae70d4038aa6234d035c872de, State: Running, Role: LEADER
I20260811 16:42:55.149137 8843 consensus_queue.cc:237] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.149868 7983 catalog_manager.cc:5495] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65). New cstate: current_term: 1 leader_uuid: "f3d1fd7ae70d4038aa6234d035c872de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } health_report { overall_health: UNKNOWN } } }
I20260811 16:42:55.184573 8967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:55.181935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53722 (local address 127.27.186.65:33155)
0811 16:42:55.182134 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:55.182136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:55.182144 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:55.182187 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:55.182187 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:55.182208 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:55.182304 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:55.182516 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.183041 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.183863 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.184066 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.184118 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:55.184259 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:55.184367 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:55.184426 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:55.184479 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 16:42:55.184497 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":123,"threads_started":1}
I20260811 16:42:55.185930 8457 raft_consensus.cc:1261] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Refusing update from remote peer f3d1fd7ae70d4038aa6234d035c872de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:55.185959 8699 raft_consensus.cc:1261] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Refusing update from remote peer f3d1fd7ae70d4038aa6234d035c872de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:55.186264 8843 consensus_queue.cc:1035] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:55.186458 8962 consensus_queue.cc:1035] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:55.190205 7983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:55.190316 7983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:55.191015 7983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: Sending DeleteTablet for 3 replicas of tablet d840eed4b60f40c681499938a719bcbf
I20260811 16:42:55.191303 8436 tablet_service.cc:1514] Processing DeleteTablet for tablet d840eed4b60f40c681499938a719bcbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:55 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:53198
I20260811 16:42:55.191345 8667 tablet_service.cc:1514] Processing DeleteTablet for tablet d840eed4b60f40c681499938a719bcbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:55 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:52572
I20260811 16:42:55.191416 8939 tablet_replica.cc:330] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: stopping tablet replica
I20260811 16:42:55.191464 8939 raft_consensus.cc:2229] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:55.191458 8199 tablet_service.cc:1514] Processing DeleteTablet for tablet d840eed4b60f40c681499938a719bcbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:55 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:53720
I20260811 16:42:55.191514 8939 raft_consensus.cc:2258] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:55.191553 8938 tablet_replica.cc:330] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: stopping tablet replica
I20260811 16:42:55.191606 8938 raft_consensus.cc:2229] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:55.191615 8936 tablet_replica.cc:330] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: stopping tablet replica
I20260811 16:42:55.191669 8936 raft_consensus.cc:2229] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:55.191689 8938 raft_consensus.cc:2258] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:55.191713 8936 raft_consensus.cc:2258] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:55.191892 8939 ts_tablet_manager.cc:1905] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:55.191855 7983 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55280:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:42:55.192003 7983 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:42:55.192085 8936 ts_tablet_manager.cc:1905] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:55.193807 8936 ts_tablet_manager.cc:1918] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:55.193874 8936 log.cc:1196] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/d840eed4b60f40c681499938a719bcbf
I20260811 16:42:55.194126 8936 ts_tablet_manager.cc:1939] T d840eed4b60f40c681499938a719bcbf P 2c0c25421db64790bdf1c03b037700e5: Deleting consensus metadata
I20260811 16:42:55.194620 7958 catalog_manager.cc:4841] TS 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055): tablet d840eed4b60f40c681499938a719bcbf (table test-table [id=917adf7c48ff4ac1af4effa420fb55e4]) successfully deleted
I20260811 16:42:55.196238 8938 ts_tablet_manager.cc:1905] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:55.197839 8938 ts_tablet_manager.cc:1918] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:55.197894 8938 log.cc:1196] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/d840eed4b60f40c681499938a719bcbf
I20260811 16:42:55.198149 8938 ts_tablet_manager.cc:1939] T d840eed4b60f40c681499938a719bcbf P f3d1fd7ae70d4038aa6234d035c872de: Deleting consensus metadata
I20260811 16:42:55.198549 7957 catalog_manager.cc:4841] TS f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155): tablet d840eed4b60f40c681499938a719bcbf (table test-table [id=917adf7c48ff4ac1af4effa420fb55e4]) successfully deleted
I20260811 16:42:55.199965 8939 ts_tablet_manager.cc:1918] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:42:55.200021 8939 log.cc:1196] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/d840eed4b60f40c681499938a719bcbf
I20260811 16:42:55.200198 8939 ts_tablet_manager.cc:1939] T d840eed4b60f40c681499938a719bcbf P edcc9021120f4a52b167ef98eb3cd9e7: Deleting consensus metadata
I20260811 16:42:55.201220 8436 tablet_service.cc:1467] Processing CreateTablet for tablet f31adef7c12448c1a3eb57f7d0976155 (DEFAULT_TABLE table=test-table [id=2e0118fd1ada4fcab9b26d375a6b8cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:55.201324 8436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31adef7c12448c1a3eb57f7d0976155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:55.203078 8836 tablet_bootstrap.cc:492] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: Bootstrap starting.
I20260811 16:42:55.203401 8667 tablet_service.cc:1467] Processing CreateTablet for tablet f31adef7c12448c1a3eb57f7d0976155 (DEFAULT_TABLE table=test-table [id=2e0118fd1ada4fcab9b26d375a6b8cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:55.203498 8836 tablet_bootstrap.cc:654] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:55.203539 8667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31adef7c12448c1a3eb57f7d0976155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:55.204192 8199 tablet_service.cc:1467] Processing CreateTablet for tablet f31adef7c12448c1a3eb57f7d0976155 (DEFAULT_TABLE table=test-table [id=2e0118fd1ada4fcab9b26d375a6b8cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:42:55.204295 8199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f31adef7c12448c1a3eb57f7d0976155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:55.204978 8835 tablet_bootstrap.cc:492] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: Bootstrap starting.
I20260811 16:42:55.205307 8835 tablet_bootstrap.cc:654] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:55.205467 7960 catalog_manager.cc:4841] TS edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653): tablet d840eed4b60f40c681499938a719bcbf (table test-table [id=917adf7c48ff4ac1af4effa420fb55e4]) successfully deleted
I20260811 16:42:55.205618 8834 tablet_bootstrap.cc:492] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de: Bootstrap starting.
I20260811 16:42:55.205862 8835 tablet_bootstrap.cc:492] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: No bootstrap required, opened a new log
I20260811 16:42:55.205904 8835 ts_tablet_manager.cc:1397] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:55.206070 8834 tablet_bootstrap.cc:654] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:55.206060 8835 raft_consensus.cc:348] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.206128 8835 raft_consensus.cc:374] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:55.206154 8835 raft_consensus.cc:729] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0c25421db64790bdf1c03b037700e5, State: Initialized, Role: FOLLOWER
I20260811 16:42:55.206197 8835 consensus_queue.cc:260] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.206282 8835 ts_tablet_manager.cc:1428] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:55.206907 8834 tablet_bootstrap.cc:492] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de: No bootstrap required, opened a new log
I20260811 16:42:55.206959 8834 ts_tablet_manager.cc:1397] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:55.207062 8836 tablet_bootstrap.cc:492] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: No bootstrap required, opened a new log
I20260811 16:42:55.207111 8836 ts_tablet_manager.cc:1397] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260811 16:42:55.207108 8834 raft_consensus.cc:348] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.207167 8834 raft_consensus.cc:374] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:55.207187 8834 raft_consensus.cc:729] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d1fd7ae70d4038aa6234d035c872de, State: Initialized, Role: FOLLOWER
I20260811 16:42:55.207242 8834 consensus_queue.cc:260] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.207276 8836 raft_consensus.cc:348] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.207343 8834 ts_tablet_manager.cc:1428] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:55.207360 8836 raft_consensus.cc:374] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:55.207383 8836 raft_consensus.cc:729] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcc9021120f4a52b167ef98eb3cd9e7, State: Initialized, Role: FOLLOWER
I20260811 16:42:55.207425 8836 consensus_queue.cc:260] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.207521 8836 ts_tablet_manager.cc:1428] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 16:42:55.448401 8976 raft_consensus.cc:482] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:42:55.448549 8976 raft_consensus.cc:504] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.448774 8976 leader_election.cc:288] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653), 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055)
I20260811 16:42:55.449039 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31adef7c12448c1a3eb57f7d0976155" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" is_pre_election: true
I20260811 16:42:55.449030 8699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31adef7c12448c1a3eb57f7d0976155" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0c25421db64790bdf1c03b037700e5" is_pre_election: true
I20260811 16:42:55.449132 8457 raft_consensus.cc:2454] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d1fd7ae70d4038aa6234d035c872de in term 0.
I20260811 16:42:55.449156 8699 raft_consensus.cc:2454] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3d1fd7ae70d4038aa6234d035c872de in term 0.
I20260811 16:42:55.449309 8130 leader_election.cc:302] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcc9021120f4a52b167ef98eb3cd9e7, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:55.449440 8976 raft_consensus.cc:2781] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:42:55.449512 8976 raft_consensus.cc:482] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:42:55.449535 8976 raft_consensus.cc:3037] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:55.450357 8976 raft_consensus.cc:504] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.450501 8976 leader_election.cc:288] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 election: Requested vote from peers edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653), 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055)
I20260811 16:42:55.450677 8699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31adef7c12448c1a3eb57f7d0976155" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0c25421db64790bdf1c03b037700e5"
I20260811 16:42:55.450779 8699 raft_consensus.cc:3037] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:55.450722 8457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f31adef7c12448c1a3eb57f7d0976155" candidate_uuid: "f3d1fd7ae70d4038aa6234d035c872de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcc9021120f4a52b167ef98eb3cd9e7"
I20260811 16:42:55.450825 8457 raft_consensus.cc:3037] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:55.451426 8699 raft_consensus.cc:2454] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d1fd7ae70d4038aa6234d035c872de in term 1.
I20260811 16:42:55.451613 8457 raft_consensus.cc:2454] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3d1fd7ae70d4038aa6234d035c872de in term 1.
I20260811 16:42:55.451622 8128 leader_election.cc:302] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c0c25421db64790bdf1c03b037700e5, f3d1fd7ae70d4038aa6234d035c872de; no voters:
I20260811 16:42:55.451745 8976 raft_consensus.cc:2781] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:55.451792 8976 raft_consensus.cc:686] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 1 LEADER]: Becoming Leader. State: Replica: f3d1fd7ae70d4038aa6234d035c872de, State: Running, Role: LEADER
I20260811 16:42:55.451854 8976 consensus_queue.cc:237] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } }
I20260811 16:42:55.452526 7983 catalog_manager.cc:5495] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de reported cstate change: term changed from 0 to 1, leader changed from <none> to f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65). New cstate: current_term: 1 leader_uuid: "f3d1fd7ae70d4038aa6234d035c872de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3d1fd7ae70d4038aa6234d035c872de" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 33155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 } health_report { overall_health: UNKNOWN } } }
I20260811 16:42:55.499285 8990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:55.496754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:54099 (local address 127.27.186.67:46055)
0811 16:42:55.496873 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:55.496875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:55.496884 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:55.496940 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:55.496940 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:55.496951 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:55.497006 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:55.497136 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.497721 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.498538 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.498744 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.498824 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:55.499050 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:55.499085 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:55.499138 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:55.499198 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 16:42:55.499219 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":49,"threads_started":1}
I20260811 16:42:55.499356 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:55.496660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:46055 (local address 127.27.186.65:54099)
0811 16:42:55.496837 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:55.496848 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:55.496895 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:55.497008 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:55.497009 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:55.497010 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:55.497086 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:55.497088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.497797 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.497798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:55.498445 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:55.498447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.498842 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.498843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:55.498894 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:55.498912 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:55.499140 (+ 228us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:55.499144 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:42:55.499191 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:42:55.499237 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":114,"threads_started":1}
I20260811 16:42:55.501694 8699 raft_consensus.cc:1261] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Refusing update from remote peer f3d1fd7ae70d4038aa6234d035c872de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:55.501741 8457 raft_consensus.cc:1261] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Refusing update from remote peer f3d1fd7ae70d4038aa6234d035c872de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:42:55.501947 8976 consensus_queue.cc:1035] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0c25421db64790bdf1c03b037700e5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 46055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:55.502117 8962 consensus_queue.cc:1035] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcc9021120f4a52b167ef98eb3cd9e7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 34653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:42:55.509867 8967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:55.507114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:56507 (local address 127.27.186.65:33155)
0811 16:42:55.507161 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:55.507163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:55.507261 (+ 98us) server_negotiation.cc:407] Connection header received
0811 16:42:55.507321 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:55.507322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:55.507330 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:55.507375 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:42:55.507458 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.507924 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.509107 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.509330 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.509409 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:55.509594 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:42:55.509633 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:42:55.509695 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:55.509766 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 16:42:55.509790 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:42:55.509888 8998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:55.507057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:33155 (local address 127.27.186.67:56507)
0811 16:42:55.507201 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:55.507213 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:55.507279 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:55.507381 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:55.507382 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:55.507383 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 16:42:55.507424 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:55.507425 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.508033 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.508035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:55.509020 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:55.509023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:55.509412 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:55.509413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:55.509526 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:55.509531 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 16:42:55.509698 (+ 167us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 16:42:55.509701 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:42:55.509761 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:42:55.509811 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":89,"threads_started":1}
I20260811 16:42:55.518889 7983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:55.519014 7983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:42:55.519702 7983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bb66c2f541fe4c97bdf7d0e615653039: Sending DeleteTablet for 3 replicas of tablet f31adef7c12448c1a3eb57f7d0976155
I20260811 16:42:55.519994 8667 tablet_service.cc:1514] Processing DeleteTablet for tablet f31adef7c12448c1a3eb57f7d0976155 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:55 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:52572
I20260811 16:42:55.519997 8199 tablet_service.cc:1514] Processing DeleteTablet for tablet f31adef7c12448c1a3eb57f7d0976155 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:55 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:53720
I20260811 16:42:55.520071 8436 tablet_service.cc:1514] Processing DeleteTablet for tablet f31adef7c12448c1a3eb57f7d0976155 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:42:55 UTC) from {username='oryx', principal='oryx/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:53198
I20260811 16:42:55.520133 8936 tablet_replica.cc:330] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: stopping tablet replica
I20260811 16:42:55.520166 8939 tablet_replica.cc:330] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: stopping tablet replica
I20260811 16:42:55.520201 8936 raft_consensus.cc:2229] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:55.520215 8939 raft_consensus.cc:2229] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:42:55.520236 8936 raft_consensus.cc:2258] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:55.520246 8939 raft_consensus.cc:2258] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:55.520295 8938 tablet_replica.cc:330] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de: stopping tablet replica
I20260811 16:42:55.520359 8938 raft_consensus.cc:2229] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:42:55.520418 8938 raft_consensus.cc:2258] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:42:55.520692 8939 ts_tablet_manager.cc:1905] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:55.520751 8938 ts_tablet_manager.cc:1905] T f31adef7c12448c1a3eb57f7d0976155 P f3d1fd7ae70d4038aa6234d035c872de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:55.521643 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 8093
I20260811 16:42:55.527030 8939 ts_tablet_manager.cc:1918] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:55.527098 8939 log.cc:1196] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/f31adef7c12448c1a3eb57f7d0976155
I20260811 16:42:55.527315 8939 ts_tablet_manager.cc:1939] T f31adef7c12448c1a3eb57f7d0976155 P edcc9021120f4a52b167ef98eb3cd9e7: Deleting consensus metadata
I20260811 16:42:55.527657 7960 catalog_manager.cc:4841] TS edcc9021120f4a52b167ef98eb3cd9e7 (127.27.186.66:34653): tablet f31adef7c12448c1a3eb57f7d0976155 (table test-table [id=2e0118fd1ada4fcab9b26d375a6b8cd8]) successfully deleted
I20260811 16:42:55.527894 8936 ts_tablet_manager.cc:1905] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:42:55.529465 8936 ts_tablet_manager.cc:1918] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 16:42:55.529538 8936 log.cc:1196] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/f31adef7c12448c1a3eb57f7d0976155
I20260811 16:42:55.529719 8936 ts_tablet_manager.cc:1939] T f31adef7c12448c1a3eb57f7d0976155 P 2c0c25421db64790bdf1c03b037700e5: Deleting consensus metadata
I20260811 16:42:55.530263 7958 catalog_manager.cc:4841] TS 2c0c25421db64790bdf1c03b037700e5 (127.27.186.67:46055): tablet f31adef7c12448c1a3eb57f7d0976155 (table test-table [id=2e0118fd1ada4fcab9b26d375a6b8cd8]) successfully deleted
W20260811 16:42:55.536376 7957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:33155 (error 108)
I20260811 16:42:55.536607 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 8333
I20260811 16:42:55.543078 9005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:55.541820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:33155 (local address 127.0.0.1:34302)
0811 16:42:55.542984 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:55.543035 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:33155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1148,"thread_start_us":1010,"threads_started":1}
W20260811 16:42:55.543217 7957 catalog_manager.cc:4584] TS f3d1fd7ae70d4038aa6234d035c872de (127.27.186.65:33155): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f31adef7c12448c1a3eb57f7d0976155: Network error: Client connection negotiation failed: client connection to 127.27.186.65:33155: connect: Connection refused (error 111)
I20260811 16:42:55.559392 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 8555
I20260811 16:42:55.575078 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 7930
2026-08-11T16:42:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3483 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:55 dist-test-slave-gsp7 krb5kdc[9010](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:55 dist-test-slave-gsp7 krb5kdc[9010](info): set up 2 sockets
Aug 11 16:42:55 dist-test-slave-gsp7 krb5kdc[9010](info): commencing operation
krb5kdc: starting...
W20260811 16:42:56.868644 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:56 dist-test-slave-gsp7 krb5kdc[9010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:56.998495 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35731
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:35405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:35731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:57.083148 9028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:57.083423 9028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:57.083463 9028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:57.084657 9028 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:57.084735 9028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:57.084761 9028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:57.084792 9028 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:57.084820 9028 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:57.086687 9028 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:35405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:35731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:57.086999 9028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:57.087253 9028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:57.092412 9044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:57.092412 9040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:57.092540 9038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:57.093024 9028 server_base.cc:1034] running on GCE node
I20260811 16:42:57.093297 9028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:57.093695 9028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:57.094903 9028 hybrid_clock.cc:648] HybridClock initialized: now 1786466577094894 us; error 39 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T16:42:57Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1522 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:42:57 dist-test-slave-gsp7 krb5kdc[9052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:42:57 dist-test-slave-gsp7 krb5kdc[9052](info): set up 2 sockets
Aug 11 16:42:57 dist-test-slave-gsp7 krb5kdc[9052](info): commencing operation
krb5kdc: starting...
W20260811 16:42:58.382543 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:42:58 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:42:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:42:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:42:58.517400 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39811
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:39811
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:58.600952 9079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:58.601219 9079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:58.601260 9079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:58.602453 9079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:58.602530 9079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:58.602555 9079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:58.602576 9079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:58.602607 9079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:58.604144 9079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:39811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:58.604423 9079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:58.604660 9079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:58.609757 9086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:58.609870 9079 server_base.cc:1034] running on GCE node
W20260811 16:42:58.609978 9089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:58.609752 9092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:58.610246 9079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:58.610566 9079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:58.611720 9079 hybrid_clock.cc:648] HybridClock initialized: now 1786466578611698 us; error 46 us; skew 500 ppm
Aug 11 16:42:58 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466578, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:58.614593 9079 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:58.615073 9079 webserver.cc:460] Webserver started at http://127.27.186.126:37875/ using document root <none> and password file <none>
I20260811 16:42:58.615303 9079 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:58.615348 9079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:58.615506 9079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:58.616611 9079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "bab72b84b7ce4fa8a339343439d4acb8"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "52b857d28fc0317ff69f4d306f35fb4f"
server_key_iv: "84d61c4c7a2de5fb0718957e6867f7ec"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.616992 9079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "bab72b84b7ce4fa8a339343439d4acb8"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "52b857d28fc0317ff69f4d306f35fb4f"
server_key_iv: "84d61c4c7a2de5fb0718957e6867f7ec"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.618543 9079 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:42:58.619374 9101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:58.619587 9079 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:58.619688 9079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "bab72b84b7ce4fa8a339343439d4acb8"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "52b857d28fc0317ff69f4d306f35fb4f"
server_key_iv: "84d61c4c7a2de5fb0718957e6867f7ec"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.619765 9079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:58.635082 9079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:58.637029 9079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:58.637192 9079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:58.641636 9079 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:39811
I20260811 16:42:58.641736 9179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:39811 every 8 connection(s)
I20260811 16:42:58.642081 9079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:58.642983 9181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:42:58.643311 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 9079
I20260811 16:42:58.643427 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:42:58.643640 28393 external_mini_cluster.cc:1428] Setting key 78927df8a5ea1b55dcb5671a451fd165
I20260811 16:42:58.646299 9181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Bootstrap starting.
I20260811 16:42:58.646991 9181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Neither blocks nor log segments found. Creating new log.
I20260811 16:42:58.647310 9181 log.cc:824] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:58.648115 9181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: No bootstrap required, opened a new log
I20260811 16:42:58.650275 9181 raft_consensus.cc:348] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } }
I20260811 16:42:58.650481 9181 raft_consensus.cc:374] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:42:58.650527 9181 raft_consensus.cc:729] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab72b84b7ce4fa8a339343439d4acb8, State: Initialized, Role: FOLLOWER
Aug 11 16:42:58 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:58.650660 9181 consensus_queue.cc:260] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } }
I20260811 16:42:58.650740 9181 raft_consensus.cc:388] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:58.650777 9181 raft_consensus.cc:482] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:58.650848 9181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:42:58.651571 9181 raft_consensus.cc:504] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } }
I20260811 16:42:58.651721 9181 leader_election.cc:302] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bab72b84b7ce4fa8a339343439d4acb8; no voters:
I20260811 16:42:58.652129 9181 leader_election.cc:288] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:42:58.652184 9189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:42:58.652549 9181 sys_catalog.cc:564] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:58.652396 9189 raft_consensus.cc:686] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 1 LEADER]: Becoming Leader. State: Replica: bab72b84b7ce4fa8a339343439d4acb8, State: Running, Role: LEADER
I20260811 16:42:58.652827 9189 consensus_queue.cc:237] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } }
I20260811 16:42:58.653728 9190 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab72b84b7ce4fa8a339343439d4acb8. Latest consensus state: current_term: 1 leader_uuid: "bab72b84b7ce4fa8a339343439d4acb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } } }
I20260811 16:42:58.653820 9190 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:58.654017 9211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:58.654235 9191 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bab72b84b7ce4fa8a339343439d4acb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } } }
I20260811 16:42:58.654331 9191 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:58.654728 9211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:58.655731 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:58.644218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.27.186.126:39811)
0811 16:42:58.644397 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:58.644405 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:58.644430 (+ 25us) server_negotiation.cc:407] Connection header received
0811 16:42:58.644851 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:58.644857 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:58.644902 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:58.645024 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:58.645884 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:58.646798 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:58.647823 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:58.648288 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:58.648419 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:58.651314 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:58.651318 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:58.651319 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:58.651330 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:58.653856 (+ 2526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:58.654336 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:58.654340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:58.654340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:58.654502 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:58.654748 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:58.654749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:58.654750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:58.655077 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:58.655237 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:58.655374 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 16:42:58.655524 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260811 16:42:58.656621 9211 catalog_manager.cc:1347] Generated new cluster ID: e42da8fb50eb41f6b85d942c65ddcf5e
I20260811 16:42:58.656675 9211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:58.665496 9211 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:42:58.666196 9211 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:58.671757 9211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Generated new TSK 0
I20260811 16:42:58.672006 9211 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:42:58.713146 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39811
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:58.815150 9221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:58.815447 9221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:58.815491 9221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:58.816696 9221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:58.816763 9221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:58.816808 9221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:58.818357 9221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:58.818637 9221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:58.818876 9221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:58.824206 9228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:58.824214 9227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:58.824285 9231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:58.824460 9221 server_base.cc:1034] running on GCE node
I20260811 16:42:58.824681 9221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:58.824921 9221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:58.826126 9221 hybrid_clock.cc:648] HybridClock initialized: now 1786466578826122 us; error 44 us; skew 500 ppm
Aug 11 16:42:58 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466578, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:58.829109 9221 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:42:58.829692 9221 webserver.cc:460] Webserver started at http://127.27.186.65:38753/ using document root <none> and password file <none>
I20260811 16:42:58.829933 9221 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:58.830001 9221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:58.830178 9221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:58.831261 9221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "f7486bae226141cf88847cfa0458d5bc"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "33a9cabfa88f0da06199b67fd0e0dde2"
server_key_iv: "3fafff1b9733a784208d7f73434f90e9"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.831657 9221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "f7486bae226141cf88847cfa0458d5bc"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "33a9cabfa88f0da06199b67fd0e0dde2"
server_key_iv: "3fafff1b9733a784208d7f73434f90e9"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.832988 9221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:58.833865 9248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:58.834051 9221 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:58.834174 9221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "f7486bae226141cf88847cfa0458d5bc"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "33a9cabfa88f0da06199b67fd0e0dde2"
server_key_iv: "3fafff1b9733a784208d7f73434f90e9"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.834255 9221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:58.847853 9221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:58.850519 9221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:58.850704 9221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:58.850960 9221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:58.851289 9221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:58.851346 9221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:58.851401 9221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:58.851429 9221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:58.858089 9221 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:38255
I20260811 16:42:58.858137 9447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:38255 every 8 connection(s)
I20260811 16:42:58.858510 9221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:58.860178 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 9221
I20260811 16:42:58.860298 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:42:58.860517 28393 external_mini_cluster.cc:1428] Setting key 1983e09582a5278a4bb39c55facaf7c8
Aug 11 16:42:58 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466578, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:58.869468 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:58.859395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:57495 (local address 127.27.186.126:39811)
0811 16:42:58.859499 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:58.859501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:58.859681 (+ 180us) server_negotiation.cc:407] Connection header received
0811 16:42:58.860319 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:58.860320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:58.860335 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:58.860405 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:58.861628 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:58.862157 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:58.863208 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:58.863434 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:58.863529 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:58.866206 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:58.866207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:58.866208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:58.866217 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:58.867837 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:58.868325 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:58.868327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:58.868327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:58.868397 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:58.868694 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:58.868696 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:58.868696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:58.868837 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:58.868926 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:58.869254 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 16:42:58.869354 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
I20260811 16:42:58.869712 9450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:58.859268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:57495)
0811 16:42:58.859524 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:58.859581 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:58.860164 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:58.860478 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:58.860484 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:58.861247 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:58.861464 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:58.861470 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:58.862279 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:58.862280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:58.863095 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:58.863097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:58.863543 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:58.863544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:58.863679 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:58.864330 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:58.864339 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:58.866093 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:58.867951 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:58.867960 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:58.867963 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:58.868214 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:58.868474 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:58.868475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:58.868475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:58.868598 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:58.868916 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:58.868924 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:58.869077 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 16:42:58.869229 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 16:42:58.869442 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":112,"threads_started":1}
I20260811 16:42:58.870463 9448 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39811
I20260811 16:42:58.870582 9448 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:58.870832 9448 heartbeater.cc:511] Master 127.27.186.126:39811 requested a full tablet report, sending...
I20260811 16:42:58.871428 9127 ts_manager.cc:194] Registered new tserver with Master: f7486bae226141cf88847cfa0458d5bc (127.27.186.65:38255)
I20260811 16:42:58.872026 9127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:57495
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:42:58.890651 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39811
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:58.978816 9456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:58.979035 9456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:58.979060 9456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:58.980265 9456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:58.980310 9456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:58.980337 9456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:58.981865 9456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:58.982120 9456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:58.982367 9456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:58.987596 9470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:58.987556 9464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:58.987556 9465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:58.987587 9456 server_base.cc:1034] running on GCE node
I20260811 16:42:58.988063 9456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:58.988330 9456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:58.989521 9456 hybrid_clock.cc:648] HybridClock initialized: now 1786466578989494 us; error 36 us; skew 500 ppm
Aug 11 16:42:58 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466578, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:58.992306 9456 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:42:58.992801 9456 webserver.cc:460] Webserver started at http://127.27.186.66:35859/ using document root <none> and password file <none>
I20260811 16:42:58.993040 9456 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:58.993110 9456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:58.993264 9456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:58.994426 9456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "746a71de3b66429b8d5b3d5b226dd292"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "0ee8e7e0abc422c5ec088ffc33e5a1d7"
server_key_iv: "e7beb6f650d5a22bbd0354e6ffcd9370"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.994815 9456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "746a71de3b66429b8d5b3d5b226dd292"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "0ee8e7e0abc422c5ec088ffc33e5a1d7"
server_key_iv: "e7beb6f650d5a22bbd0354e6ffcd9370"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.996208 9456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:42:58.996991 9482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:58.997169 9456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:58.997280 9456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "746a71de3b66429b8d5b3d5b226dd292"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "0ee8e7e0abc422c5ec088ffc33e5a1d7"
server_key_iv: "e7beb6f650d5a22bbd0354e6ffcd9370"
server_key_version: "encryptionkey@0"
I20260811 16:42:58.997359 9456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:59.012710 9456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:59.015393 9456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:59.015604 9456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:59.015899 9456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:59.016242 9456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:59.016299 9456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.016345 9456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:59.016369 9456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.022958 9456 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:38539
I20260811 16:42:59.023066 9681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:38539 every 8 connection(s)
I20260811 16:42:59.023411 9456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:59.027038 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 9456
I20260811 16:42:59.027130 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:42:59.027341 28393 external_mini_cluster.cc:1428] Setting key 24c2cdca81ee08efc622a5d619cf8bfd
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466578, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:59.033949 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.024160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:34061 (local address 127.27.186.126:39811)
0811 16:42:59.024224 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.024226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.024457 (+ 231us) server_negotiation.cc:407] Connection header received
0811 16:42:59.025026 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.025027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.025041 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.025093 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.026177 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.026689 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.027990 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.028208 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.028300 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.030742 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:59.030744 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:59.030745 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:59.030754 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:59.032349 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:59.032816 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:59.032818 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:59.032818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:59.032885 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:59.033162 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:59.033163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:59.033163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:59.033294 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:59.033370 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:59.033747 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 16:42:59.033853 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:42:59.034168 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.024174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:34061)
0811 16:42:59.024332 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.024370 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.024909 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.025165 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.025169 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.025848 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.026063 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.026069 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.026794 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.026795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.027914 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.027917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.028312 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.028313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.028453 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.029026 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.029035 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.030640 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:59.032469 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:59.032478 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:59.032481 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:59.032721 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:59.032956 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:59.032957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:59.032958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:59.033081 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:59.033372 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:59.033381 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:59.033603 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 16:42:59.033713 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:42:59.033896 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260811 16:42:59.035051 9682 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39811
I20260811 16:42:59.035146 9682 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:59.035367 9682 heartbeater.cc:511] Master 127.27.186.126:39811 requested a full tablet report, sending...
I20260811 16:42:59.035812 9127 ts_manager.cc:194] Registered new tserver with Master: 746a71de3b66429b8d5b3d5b226dd292 (127.27.186.66:38539)
I20260811 16:42:59.036365 9127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:34061
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:42:59.057551 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39811
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:59.144936 9690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:59.145170 9690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:59.145196 9690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:59.146368 9690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:59.146404 9690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:59.146430 9690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:59.147858 9690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:59.148154 9690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:59.148404 9690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:59.154017 9701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.154036 9699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:59.154174 9690 server_base.cc:1034] running on GCE node
W20260811 16:42:59.154066 9698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:59.154582 9690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:59.154841 9690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:59.155982 9690 hybrid_clock.cc:648] HybridClock initialized: now 1786466579155972 us; error 30 us; skew 500 ppm
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466579, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:59.158689 9690 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:42:59.159161 9690 webserver.cc:460] Webserver started at http://127.27.186.67:44013/ using document root <none> and password file <none>
I20260811 16:42:59.159408 9690 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:59.159487 9690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:59.159644 9690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:42:59.160737 9690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "fee73a25f4be4bc49a0eee8f8887ec99"
format_stamp: "Formatted at 2026-08-11 16:42:59 on dist-test-slave-gsp7"
server_key: "d6b95efa1381d65331e3d1929310b2a5"
server_key_iv: "69b71f31c1a09e74938e6e96e58268e7"
server_key_version: "encryptionkey@0"
I20260811 16:42:59.161134 9690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "fee73a25f4be4bc49a0eee8f8887ec99"
format_stamp: "Formatted at 2026-08-11 16:42:59 on dist-test-slave-gsp7"
server_key: "d6b95efa1381d65331e3d1929310b2a5"
server_key_iv: "69b71f31c1a09e74938e6e96e58268e7"
server_key_version: "encryptionkey@0"
I20260811 16:42:59.162600 9690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:42:59.163475 9709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.163796 9690 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:59.163906 9690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "fee73a25f4be4bc49a0eee8f8887ec99"
format_stamp: "Formatted at 2026-08-11 16:42:59 on dist-test-slave-gsp7"
server_key: "d6b95efa1381d65331e3d1929310b2a5"
server_key_iv: "69b71f31c1a09e74938e6e96e58268e7"
server_key_version: "encryptionkey@0"
I20260811 16:42:59.163983 9690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:59.186174 9690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:59.188406 9690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:59.188589 9690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:59.188841 9690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:59.189164 9690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:59.189220 9690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.189266 9690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:59.189291 9690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.195989 9690 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:36525
I20260811 16:42:59.196035 9915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:36525 every 8 connection(s)
I20260811 16:42:59.196399 9690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466579, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:42:59.203658 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 9690
I20260811 16:42:59.203786 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:42:59.204001 28393 external_mini_cluster.cc:1428] Setting key fc9374d039abfc791bc9fbb8b93a988f
I20260811 16:42:59.206658 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.197197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:55967 (local address 127.27.186.126:39811)
0811 16:42:59.197269 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.197272 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.197628 (+ 356us) server_negotiation.cc:407] Connection header received
0811 16:42:59.198178 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.198179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.198190 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.198271 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.199213 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.199717 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.200762 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.200956 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.201013 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.203310 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:59.203311 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:59.203312 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:59.203318 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:59.205164 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:59.205600 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:59.205600 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:59.205601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:59.205656 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:59.205977 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:59.205978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:59.205979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:59.206117 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:59.206176 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:59.206525 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 16:42:59.206593 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:42:59.206945 9920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.197168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:55967)
0811 16:42:59.197374 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.197414 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.198085 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.198328 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.198332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.198924 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.199124 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.199129 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.199800 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.199801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.200685 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.200687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.201037 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.201038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.201144 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.201737 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.201746 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.203176 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:42:59.205258 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:59.205265 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:59.205267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:59.205518 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:59.205744 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:42:59.205745 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:42:59.205745 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:42:59.205858 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:42:59.206199 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:42:59.206205 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:42:59.206326 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 16:42:59.206492 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 16:42:59.206667 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":108,"threads_started":1}
I20260811 16:42:59.207443 9917 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39811
I20260811 16:42:59.207553 9917 heartbeater.cc:464] Registering TS with master...
I20260811 16:42:59.207748 9917 heartbeater.cc:511] Master 127.27.186.126:39811 requested a full tablet report, sending...
I20260811 16:42:59.208169 9127 ts_manager.cc:194] Registered new tserver with Master: fee73a25f4be4bc49a0eee8f8887ec99 (127.27.186.67:36525)
I20260811 16:42:59.208511 9127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:55967
I20260811 16:42:59.215968 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab.
Entry for principal oryx/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab.
WARNING: no policy specified for oryx/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab.
Entry for principal oryx/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab.
WARNING: no policy specified for oryx/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab.
Entry for principal oryx/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab.
I20260811 16:42:59.300163 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 9221
I20260811 16:42:59.312813 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 9456
I20260811 16:42:59.322286 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 9690
I20260811 16:42:59.344492 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 9079
I20260811 16:42:59.361002 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39811
--webserver_interface=127.27.186.126
--webserver_port=37875
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:39811
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:42:59.443892 9941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:59.444157 9941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:59.444195 9941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:59.445338 9941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:42:59.445413 9941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:59.445438 9941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:59.445457 9941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:42:59.445474 9941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:42:59.447002 9941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:39811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=37875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:59.447281 9941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:59.447521 9941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:59.452572 9958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.452574 9953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.452601 9960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:59.452925 9941 server_base.cc:1034] running on GCE node
I20260811 16:42:59.453181 9941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:59.453523 9941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:59.454708 9941 hybrid_clock.cc:648] HybridClock initialized: now 1786466579454695 us; error 40 us; skew 500 ppm
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466579, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:59.457229 9941 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:42:59.457748 9941 webserver.cc:460] Webserver started at http://127.27.186.126:37875/ using document root <none> and password file <none>
I20260811 16:42:59.457986 9941 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:59.458072 9941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:59.459586 9941 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:59.460304 9973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.460608 9941 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:59.460719 9941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "bab72b84b7ce4fa8a339343439d4acb8"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "52b857d28fc0317ff69f4d306f35fb4f"
server_key_iv: "84d61c4c7a2de5fb0718957e6867f7ec"
server_key_version: "encryptionkey@0"
I20260811 16:42:59.461105 9941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:59.471571 9941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:59.473737 9941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:59.473922 9941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:59.478420 9941 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:39811
I20260811 16:42:59.478468 10067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:39811 every 8 connection(s)
I20260811 16:42:59.478888 9941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:42:59.480356 10072 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:42:59.481026 10072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Bootstrap starting.
I20260811 16:42:59.486675 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 9941
I20260811 16:42:59.486995 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:38255
--local_ip_for_outbound_sockets=127.27.186.65
--tserver_master_addrs=127.27.186.126:39811
--webserver_port=38753
--webserver_interface=127.27.186.65
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.186.65
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:42:59.490041 10072 log.cc:824] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:42:59.491740 10072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:42:59.492046 10072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Bootstrap complete.
I20260811 16:42:59.494590 10072 raft_consensus.cc:348] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } }
I20260811 16:42:59.494853 10072 raft_consensus.cc:729] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab72b84b7ce4fa8a339343439d4acb8, State: Initialized, Role: FOLLOWER
I20260811 16:42:59.495077 10072 consensus_queue.cc:260] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } }
I20260811 16:42:59.495185 10072 raft_consensus.cc:388] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:42:59.495249 10072 raft_consensus.cc:482] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:42:59.495301 10072 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:42:59.496408 10072 raft_consensus.cc:504] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } }
I20260811 16:42:59.496503 10072 leader_election.cc:302] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bab72b84b7ce4fa8a339343439d4acb8; no voters:
I20260811 16:42:59.496702 10072 leader_election.cc:288] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:42:59.496774 10081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:42:59.496943 10081 raft_consensus.cc:686] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [term 2 LEADER]: Becoming Leader. State: Replica: bab72b84b7ce4fa8a339343439d4acb8, State: Running, Role: LEADER
I20260811 16:42:59.496999 10072 sys_catalog.cc:564] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:42:59.497149 10081 consensus_queue.cc:237] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } }
I20260811 16:42:59.498225 10083 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bab72b84b7ce4fa8a339343439d4acb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } } }
I20260811 16:42:59.498343 10083 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:59.498255 10085 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab72b84b7ce4fa8a339343439d4acb8. Latest consensus state: current_term: 2 leader_uuid: "bab72b84b7ce4fa8a339343439d4acb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab72b84b7ce4fa8a339343439d4acb8" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39811 } } }
I20260811 16:42:59.498617 10085 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8 [sys.catalog]: This master's current role is: LEADER
I20260811 16:42:59.499259 10109 catalog_manager.cc:1259] Loaded cluster ID: e42da8fb50eb41f6b85d942c65ddcf5e
I20260811 16:42:59.499310 10109 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: loading cluster ID for follower catalog manager: success
I20260811 16:42:59.500448 10109 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: acquiring CA information for follower catalog manager: success
I20260811 16:42:59.500783 10109 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:42:59.500957 10107 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:42:59.501120 10107 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:42:59.501194 10107 catalog_manager.cc:1259] Loaded cluster ID: e42da8fb50eb41f6b85d942c65ddcf5e
I20260811 16:42:59.501230 10107 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:42:59.501451 10107 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:42:59.501585 10107 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bab72b84b7ce4fa8a339343439d4acb8: Loaded TSK: 0
I20260811 16:42:59.501731 10107 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:42:59.573024 10076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:59.573268 10076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:59.573307 10076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:59.574530 10076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:59.574599 10076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:59.574644 10076 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:42:59.576092 10076 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.65.keytab
--principal=oryx/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:38255
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=38753
--tserver_master_addrs=127.27.186.126:39811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10076
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:59.576364 10076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:59.576604 10076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:59.582762 10119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.582708 10117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.582717 10116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:59.583043 10076 server_base.cc:1034] running on GCE node
I20260811 16:42:59.583335 10076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:59.583621 10076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:59.584811 10076 hybrid_clock.cc:648] HybridClock initialized: now 1786466579584792 us; error 30 us; skew 500 ppm
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466579, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:59.587909 10076 init.cc:377] Logged in from keytab as oryx/127.27.186.65@KRBTEST.COM (short username oryx)
I20260811 16:42:59.588421 10076 webserver.cc:460] Webserver started at http://127.27.186.65:38753/ using document root <none> and password file <none>
I20260811 16:42:59.588682 10076 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:59.588775 10076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:59.590298 10076 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:59.590965 10130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.591141 10076 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:59.591252 10076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "f7486bae226141cf88847cfa0458d5bc"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "33a9cabfa88f0da06199b67fd0e0dde2"
server_key_iv: "3fafff1b9733a784208d7f73434f90e9"
server_key_version: "encryptionkey@0"
I20260811 16:42:59.591609 10076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:59.629060 10076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:59.631647 10076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:59.631830 10076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:59.632102 10076 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:59.632429 10076 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:59.632488 10076 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.632529 10076 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:59.632553 10076 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.639786 10076 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:38255
I20260811 16:42:59.639837 10320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:38255 every 8 connection(s)
I20260811 16:42:59.640198 10076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:42:59.643440 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 10076
I20260811 16:42:59.643760 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:38539
--local_ip_for_outbound_sockets=127.27.186.66
--tserver_master_addrs=127.27.186.126:39811
--webserver_port=35859
--webserver_interface=127.27.186.66
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.186.66
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:42:59.649772 10328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.640881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:46971)
0811 16:42:59.641066 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.641110 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.641677 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.642094 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.642097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.642688 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.642880 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.642885 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.644192 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.644193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.645522 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.645526 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.646402 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.646403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.646509 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.647053 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.647062 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.649557 (+ 2495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":106,"threads_started":1}
W20260811 16:42:59.649814 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.640990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:46971 (local address 127.27.186.126:39811)
0811 16:42:59.641197 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.641207 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.641246 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:42:59.641865 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.641871 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.641917 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.642039 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.642995 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.644086 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.645640 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.646306 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.646450 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.649670 (+ 3220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:46971: BlockingRecv error: recv got EOF from 127.27.186.65:46971 (error 108)
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":110,"threads_started":1}
W20260811 16:42:59.650025 10323 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:39811 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.186.126:39811: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:42:59.654995 10328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.650294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:57709)
0811 16:42:59.650337 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.650348 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.650435 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.650574 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.650574 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.650705 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.650749 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.650750 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.651380 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.651381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.651885 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.651887 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.652268 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.652268 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.652338 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.652824 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.652829 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.654883 (+ 2054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 16:42:59.655040 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.650363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:57709 (local address 127.27.186.126:39811)
0811 16:42:59.650425 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.650428 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.650437 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:42:59.650499 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.650500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.650513 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.650570 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.650826 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.651296 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.651983 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.652180 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.652266 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.654984 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:57709: BlockingRecv error: recv got EOF from 127.27.186.65:57709 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:42:59.659898 10328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.655292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:51999)
0811 16:42:59.655446 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.655458 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.655518 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.655677 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.655678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.655804 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.655834 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.655835 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.656448 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.656449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.656950 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.656951 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.657288 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.657289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.657342 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.657842 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.657846 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.659824 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":102,"threads_started":1}
W20260811 16:42:59.660022 10323 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:42:59.660048 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.655355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:51999 (local address 127.27.186.126:39811)
0811 16:42:59.655448 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.655450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.655510 (+ 60us) server_negotiation.cc:407] Connection header received
0811 16:42:59.655578 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.655579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.655588 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.655653 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.655920 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.656363 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.657035 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.657216 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.657290 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.659960 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:51999: BlockingRecv error: recv got EOF from 127.27.186.65:51999 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260811 16:42:59.731336 10330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:59.731549 10330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:59.731572 10330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:59.732666 10330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:59.732699 10330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:59.732724 10330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:42:59.734227 10330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.66.keytab
--principal=oryx/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:38539
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=35859
--tserver_master_addrs=127.27.186.126:39811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:59.734431 10330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:59.734609 10330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:59.740063 10341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.740072 10345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.740073 10342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:59.740532 10330 server_base.cc:1034] running on GCE node
I20260811 16:42:59.740803 10330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:59.741072 10330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:59.742242 10330 hybrid_clock.cc:648] HybridClock initialized: now 1786466579742229 us; error 31 us; skew 500 ppm
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466579, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:59.744839 10330 init.cc:377] Logged in from keytab as oryx/127.27.186.66@KRBTEST.COM (short username oryx)
I20260811 16:42:59.745260 10330 webserver.cc:460] Webserver started at http://127.27.186.66:35859/ using document root <none> and password file <none>
I20260811 16:42:59.745460 10330 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:59.745589 10330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:59.746956 10330 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:59.747514 10358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.747696 10330 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:42:59.747774 10330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "746a71de3b66429b8d5b3d5b226dd292"
format_stamp: "Formatted at 2026-08-11 16:42:58 on dist-test-slave-gsp7"
server_key: "0ee8e7e0abc422c5ec088ffc33e5a1d7"
server_key_iv: "e7beb6f650d5a22bbd0354e6ffcd9370"
server_key_version: "encryptionkey@0"
I20260811 16:42:59.748116 10330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:59.787379 10330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:59.789933 10330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:59.790076 10330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:59.790287 10330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:59.790648 10330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:59.790709 10330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.790756 10330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:59.790786 10330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.797303 10330 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:38539
I20260811 16:42:59.797354 10561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:38539 every 8 connection(s)
I20260811 16:42:59.797854 10330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:42:59.800657 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 10330
I20260811 16:42:59.800976 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:36525
--local_ip_for_outbound_sockets=127.27.186.67
--tserver_master_addrs=127.27.186.126:39811
--webserver_port=44013
--webserver_interface=127.27.186.67
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.27.186.67
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:42:59.805951 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.798646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:45517 (local address 127.27.186.126:39811)
0811 16:42:59.798718 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.798720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.798938 (+ 218us) server_negotiation.cc:407] Connection header received
0811 16:42:59.799512 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.799513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.799533 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.799584 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.800604 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.801338 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.802437 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.802656 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.802740 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.805888 (+ 3148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:45517: BlockingRecv error: recv got EOF from 127.27.186.66:45517 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:42:59.806026 10567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.798639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:45517)
0811 16:42:59.798800 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.798839 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.799381 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.799655 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.799659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.800269 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.800475 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.800481 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.801456 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.801457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.802328 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.802331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.802750 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.802752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.802896 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.803483 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.803492 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.805804 (+ 2312us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
W20260811 16:42:59.806254 10564 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:39811 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.186.126:39811: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:42:59.811232 10567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.806535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:60663)
0811 16:42:59.806571 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.806581 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.806650 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.806770 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.806771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.806915 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.806965 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.806967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.807617 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.807618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.808136 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.808138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.808699 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.808700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.808782 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.809274 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.809279 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.811139 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 16:42:59.811295 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.806591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:60663 (local address 127.27.186.126:39811)
0811 16:42:59.806662 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.806664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.806674 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:42:59.806702 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.806703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.806713 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.806769 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.807044 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.807531 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.808242 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.808571 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.808696 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.811226 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:60663: BlockingRecv error: recv got EOF from 127.27.186.66:60663 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:42:59.816499 10567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.811605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:56131)
0811 16:42:59.811670 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.811684 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.811760 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.811911 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.811912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.812081 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.812132 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.812134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.812792 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.812793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.813656 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.813658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.813991 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.813992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.814047 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.814495 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.814501 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.816420 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 16:42:59.816654 10564 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:42:59.816674 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.811664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:56131 (local address 127.27.186.126:39811)
0811 16:42:59.811685 (+ 21us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.811687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.811756 (+ 69us) server_negotiation.cc:407] Connection header received
0811 16:42:59.811827 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.811827 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.811836 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.811883 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.812217 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.812708 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.813737 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.813917 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.813975 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.816513 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:56131: BlockingRecv error: recv got EOF from 127.27.186.66:56131 (error 108)
Metrics: {"server-negotiator.queue_time_us":3}
W20260811 16:42:59.888703 10568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:42:59.888932 10568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:42:59.888957 10568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:42:59.890095 10568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:42:59.890133 10568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:42:59.890159 10568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:42:59.891606 10568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/krb5kdc/oryx_127.27.186.67.keytab
--principal=oryx/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:36525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=44013
--tserver_master_addrs=127.27.186.126:39811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:42:59.891803 10568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:42:59.891980 10568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:42:59.897192 10580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.897272 10586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:42:59.897219 10579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:42:59.897584 10568 server_base.cc:1034] running on GCE node
I20260811 16:42:59.897855 10568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:42:59.898120 10568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:42:59.899289 10568 hybrid_clock.cc:648] HybridClock initialized: now 1786466579899287 us; error 42 us; skew 500 ppm
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466579, etypes {rep=17 tkt=17 ses=17}, oryx/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:42:59.901943 10568 init.cc:377] Logged in from keytab as oryx/127.27.186.67@KRBTEST.COM (short username oryx)
I20260811 16:42:59.902325 10568 webserver.cc:460] Webserver started at http://127.27.186.67:44013/ using document root <none> and password file <none>
I20260811 16:42:59.902509 10568 fs_manager.cc:359] Metadata directory not provided
I20260811 16:42:59.902563 10568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:42:59.903923 10568 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:42:59.904578 10599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.904745 10568 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:42:59.904838 10568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "fee73a25f4be4bc49a0eee8f8887ec99"
format_stamp: "Formatted at 2026-08-11 16:42:59 on dist-test-slave-gsp7"
server_key: "d6b95efa1381d65331e3d1929310b2a5"
server_key_iv: "69b71f31c1a09e74938e6e96e58268e7"
server_key_version: "encryptionkey@0"
I20260811 16:42:59.905192 10568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:42:59.932936 10568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:42:59.935060 10568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:42:59.935217 10568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:42:59.935495 10568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:42:59.935834 10568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:42:59.935868 10568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.935912 10568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:42:59.935940 10568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:42:59.944476 10568 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:36525
I20260811 16:42:59.944548 10801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:36525 every 8 connection(s)
I20260811 16:42:59.944887 10568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:42:59.947573 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 10568
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 16:42:59.953302 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.945726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:41275 (local address 127.27.186.126:39811)
0811 16:42:59.945798 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.945800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.946016 (+ 216us) server_negotiation.cc:407] Connection header received
0811 16:42:59.946515 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.946516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.946527 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.946583 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.947527 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.948249 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.949549 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.949765 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.949837 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.953241 (+ 3404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:41275: BlockingRecv error: recv got EOF from 127.27.186.67:41275 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:42:59.953465 10804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.945728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:41275)
0811 16:42:59.945889 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.945927 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.946430 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.946635 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.946638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.947223 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.947432 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.947438 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.948329 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.948330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.949435 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.949438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.949857 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.949858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.949964 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.950555 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.950564 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.953181 (+ 2617us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
W20260811 16:42:59.953809 10802 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:39811 (0 consecutive failures): Not authorized: Failed to ping master at 127.27.186.126:39811: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
I20260811 16:42:59.955986 10806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.948108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50610 (local address 127.27.186.126:39811)
0811 16:42:59.948255 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.948256 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.948264 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:59.948286 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.948287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.948298 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.948371 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.948988 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.949672 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.950623 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.950932 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.950999 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.952340 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:42:59.952345 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:42:59.952345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:42:59.952357 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:42:59.954507 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:59.954916 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:59.954919 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:59.954920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:59.955013 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:42:59.955219 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:42:59.955219 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:42:59.955220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:42:59.955528 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:42:59.955670 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 16:42:59.955765 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 16:42:59.955872 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:42:59.958705 10804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.954051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:54749)
0811 16:42:59.954096 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.954105 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.954142 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.954263 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.954263 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.954434 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.954493 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.954495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.955292 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.955293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.956067 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.956071 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.956522 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.956523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.956616 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.957052 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.957057 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.958660 (+ 1603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 16:42:59.958832 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.954092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:54749 (local address 127.27.186.126:39811)
0811 16:42:59.954126 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.954128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.954143 (+ 15us) server_negotiation.cc:407] Connection header received
0811 16:42:59.954201 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.954202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.954208 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.954254 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.954581 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.955210 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.956161 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.956437 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.956504 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.958758 (+ 2254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:54749: BlockingRecv error: recv got EOF from 127.27.186.67:54749 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:42:59 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:42:59.962689 10804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:42:59.959122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:40109)
0811 16:42:59.959171 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:42:59.959182 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:42:59.959224 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:42:59.959352 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:42:59.959353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:42:59.959454 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:42:59.959480 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.959481 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.960027 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.960027 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.960485 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:42:59.960486 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.960782 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.960782 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:42:59.960817 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.961140 (+ 323us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:42:59.961144 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:42:59.962646 (+ 1502us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 16:42:59.962778 10329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:42:59.959200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:40109 (local address 127.27.186.126:39811)
0811 16:42:59.959255 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:42:59.959257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:42:59.959265 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:42:59.959291 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:42:59.959291 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:42:59.959298 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:42:59.959348 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:42:59.959537 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.959963 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.960551 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:42:59.960718 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:42:59.960770 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:42:59.962720 (+ 1950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:40109: BlockingRecv error: recv got EOF from 127.27.186.67:40109 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 16:42:59.962870 10802 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 16:43:00 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:00 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:00.669735 10809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:00.660461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:40059)
0811 16:43:00.660631 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:00.660643 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:00.660707 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:00.660897 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:00.660898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:00.661095 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:00.661149 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:00.661151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.661885 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.661886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:00.662522 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:00.662523 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.662888 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.662889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:00.662940 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:00.667607 (+ 4667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:00.667613 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:00.669616 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":99,"threads_started":1}
W20260811 16:43:00.669796 10810 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:00.660526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:40059 (local address 127.27.186.126:39811)
0811 16:43:00.660662 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:00.660664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:00.660682 (+ 18us) server_negotiation.cc:407] Connection header received
0811 16:43:00.660769 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:00.660769 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:00.660779 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:00.660842 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:00.661224 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.661803 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.662600 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.662796 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.662850 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:00.669713 (+ 6863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:40059: BlockingRecv error: recv got EOF from 127.27.186.65:40059 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
Aug 11 16:43:00 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:00 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:00.822039 10811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:00.817070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:47035)
0811 16:43:00.817225 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:00.817237 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:00.817309 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:00.817495 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:00.817496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:00.817678 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:00.817730 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:00.817732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.818437 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.818438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:00.819009 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:00.819011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.819369 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.819370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:00.819412 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:00.819904 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:00.819909 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:00.821930 (+ 2021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":66,"threads_started":1}
W20260811 16:43:00.822190 10810 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:00.817165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:47035 (local address 127.27.186.126:39811)
0811 16:43:00.817225 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:00.817227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:00.817315 (+ 88us) server_negotiation.cc:407] Connection header received
0811 16:43:00.817370 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:00.817371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:00.817384 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:00.817435 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:00.817842 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.818355 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.819097 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.819294 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.819360 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:00.822041 (+ 2681us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:47035: BlockingRecv error: recv got EOF from 127.27.186.66:47035 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 11 16:43:00 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:00 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:00.968649 10812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:00.963395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:45839)
0811 16:43:00.963547 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:00.963561 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:00.963643 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:00.963778 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:00.963779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:00.963953 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:00.964008 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:00.964009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.964949 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.964950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:00.965591 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:00.965593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.965946 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.965948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:00.965995 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:00.966517 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:00.966522 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:00.968576 (+ 2054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
W20260811 16:43:00.968786 10810 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:00.963490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:45839 (local address 127.27.186.126:39811)
0811 16:43:00.963642 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:00.963644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:00.963656 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:43:00.963701 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:00.963701 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:00.963715 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:00.963773 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:00.964085 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.964882 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.965663 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:00.965842 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:00.965904 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:00.968701 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:45839: BlockingRecv error: recv got EOF from 127.27.186.67:45839 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
Aug 11 16:43:01 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:01 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:01.675390 10813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:01.670500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:42261)
0811 16:43:01.670710 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:01.670723 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:01.670796 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:01.670960 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:01.670961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:01.671143 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:01.671196 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:01.671198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.671903 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.671903 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:01.672469 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:01.672472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.672809 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.672810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:01.672850 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:01.673355 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:01.673360 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:01.675324 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":136,"threads_started":1}
W20260811 16:43:01.675559 10815 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:01.670621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:42261 (local address 127.27.186.126:39811)
0811 16:43:01.670741 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:01.670743 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:01.670775 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:43:01.670860 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:01.670861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:01.670874 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:01.670941 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:01.671291 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.671824 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.672544 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.672742 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.672795 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:01.675455 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:42261: BlockingRecv error: recv got EOF from 127.27.186.65:42261 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":62,"threads_started":1}
Aug 11 16:43:01 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:01 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:01.827728 10816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:01.822635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:49089)
0811 16:43:01.822800 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:01.822836 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:01.822935 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:01.823108 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:01.823109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:01.823302 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:01.823384 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:01.823386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.824233 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.824234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:01.824777 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:01.824779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.825183 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.825184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:01.825236 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:01.825738 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:01.825743 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:01.827627 (+ 1884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
W20260811 16:43:01.827785 10815 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:01.822787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:49089 (local address 127.27.186.126:39811)
0811 16:43:01.822867 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:01.822870 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:01.822920 (+ 50us) server_negotiation.cc:407] Connection header received
0811 16:43:01.823010 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:01.823011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:01.823025 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:01.823084 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:01.823485 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.824158 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.824874 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.825087 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.825151 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:01.827717 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:49089: BlockingRecv error: recv got EOF from 127.27.186.66:49089 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 16:43:01 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:01 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:01.973901 10817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:01.969161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:60869)
0811 16:43:01.969351 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:01.969362 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:01.969423 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:01.969581 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:01.969582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:01.969755 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:01.969810 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:01.969812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.970483 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.970484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:01.971017 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:01.971018 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.971345 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.971345 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:01.971385 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:01.971878 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:01.971883 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:01.973837 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":119,"threads_started":1}
W20260811 16:43:01.974099 10815 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:01.969285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:60869 (local address 127.27.186.126:39811)
0811 16:43:01.969355 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:01.969357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:01.969416 (+ 59us) server_negotiation.cc:407] Connection header received
0811 16:43:01.969501 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:01.969501 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:01.969512 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:01.969555 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:01.969884 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.970400 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.971096 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:01.971276 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:01.971326 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:01.973945 (+ 2619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:60869: BlockingRecv error: recv got EOF from 127.27.186.67:60869 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 16:43:02 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:02 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:02.680866 10818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:02.676032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:59233)
0811 16:43:02.676187 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:02.676199 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:02.676262 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:02.676474 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:02.676475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:02.676702 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:02.676767 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:02.676769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.677470 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.677471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:02.678049 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:02.678052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.678405 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.678406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:02.678447 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:02.679008 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:02.679013 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:02.680806 (+ 1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":73,"threads_started":1}
W20260811 16:43:02.681030 10819 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:02.676120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:59233 (local address 127.27.186.126:39811)
0811 16:43:02.676268 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:02.676271 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:02.676281 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:43:02.676342 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:02.676343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:02.676358 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:02.676449 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:02.676857 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.677369 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.678133 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.678332 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.678391 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:02.680924 (+ 2533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:59233: BlockingRecv error: recv got EOF from 127.27.186.65:59233 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
Aug 11 16:43:02 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:02 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:02.833045 10821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:02.828278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:37655)
0811 16:43:02.828517 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:02.828527 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:02.828630 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:02.828812 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:02.828813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:02.829013 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:02.829066 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:02.829069 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.829740 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.829741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:02.830288 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:02.830289 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.830609 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.830610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:02.830652 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:02.831178 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:02.831186 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:02.832980 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":90,"threads_started":1}
W20260811 16:43:02.833191 10819 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:02.828305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:37655 (local address 127.27.186.126:39811)
0811 16:43:02.828393 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:02.828396 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:02.828642 (+ 246us) server_negotiation.cc:407] Connection header received
0811 16:43:02.828685 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:02.828686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:02.828702 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:02.828789 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:02.829137 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.829667 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.830358 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.830542 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.830593 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:02.833106 (+ 2513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:37655: BlockingRecv error: recv got EOF from 127.27.186.66:37655 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 11 16:43:02 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:02 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:02.978989 10823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:02.974400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:36939)
0811 16:43:02.974593 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:02.974605 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:02.974677 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:02.974792 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:02.974793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:02.974966 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:02.975020 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:02.975022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.975677 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.975678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:02.976224 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:02.976226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.976558 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.976559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:02.976601 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:02.977064 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:02.977068 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:02.978929 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":91,"threads_started":1}
W20260811 16:43:02.979091 10819 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:02.974518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:36939 (local address 127.27.186.126:39811)
0811 16:43:02.974592 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:02.974594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:02.974673 (+ 79us) server_negotiation.cc:407] Connection header received
0811 16:43:02.974724 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:02.974725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:02.974735 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:02.974783 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:02.975078 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.975580 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.976301 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:02.976490 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:02.976541 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:02.979022 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:36939: BlockingRecv error: recv got EOF from 127.27.186.67:36939 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 16:43:03 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:03 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:03.686154 10825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:03.681366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:52189)
0811 16:43:03.681579 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:03.681593 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:03.681664 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:03.681812 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:03.681812 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:03.682012 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:03.682062 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:03.682064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.682781 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.682782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:03.683323 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:03.683325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.683714 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.683715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:03.683779 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:03.684262 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:03.684267 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:03.686056 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":135,"threads_started":1}
W20260811 16:43:03.686218 10826 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:03.681440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:52189 (local address 127.27.186.126:39811)
0811 16:43:03.681584 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:03.681586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:03.681640 (+ 54us) server_negotiation.cc:407] Connection header received
0811 16:43:03.681727 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:03.681728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:03.681740 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:03.681796 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:03.682149 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.682690 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.683419 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.683637 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.683715 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:03.686144 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:52189: BlockingRecv error: recv got EOF from 127.27.186.65:52189 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":71,"threads_started":1}
Aug 11 16:43:03 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:03 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:03.838966 10827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:03.833653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:40301)
0811 16:43:03.833849 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:03.833861 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:03.833964 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:03.834197 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:03.834198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:03.834451 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:03.834541 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:03.834544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.835270 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.835271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:03.835799 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:03.835800 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.836170 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.836171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:03.836213 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:03.836694 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:03.836699 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:03.838904 (+ 2205us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":96,"threads_started":1}
W20260811 16:43:03.839073 10826 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:03.833802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:40301 (local address 127.27.186.126:39811)
0811 16:43:03.833909 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:03.833911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:03.833939 (+ 28us) server_negotiation.cc:407] Connection header received
0811 16:43:03.834073 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:03.834075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:03.834089 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:03.834156 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:03.834631 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.835193 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.835896 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.836092 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.836161 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:03.839002 (+ 2841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:40301: BlockingRecv error: recv got EOF from 127.27.186.66:40301 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 16:43:03 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:03 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:03.984483 10829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:03.979537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:49047)
0811 16:43:03.979805 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:03.979817 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:03.979877 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:03.980037 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:03.980037 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:03.980210 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:03.980263 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:03.980265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.980935 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.980936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:03.981512 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:03.981514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.981889 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.981890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:03.981930 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:03.982445 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:03.982450 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:03.984415 (+ 1965us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":206,"threads_started":1}
W20260811 16:43:03.984620 10826 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:03.979677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:49047 (local address 127.27.186.126:39811)
0811 16:43:03.979731 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:03.979733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:03.979907 (+ 174us) server_negotiation.cc:407] Connection header received
0811 16:43:03.979939 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:03.979940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:03.979954 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:03.980016 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:03.980343 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.980855 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.981605 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:03.981810 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:03.981882 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:03.984533 (+ 2651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:49047: BlockingRecv error: recv got EOF from 127.27.186.67:49047 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 16:43:04 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:04 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:04.691820 10831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:04.686807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:33225)
0811 16:43:04.686982 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:04.686995 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:04.687066 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:04.687213 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:04.687214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:04.687425 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:04.687489 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:04.687491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.688208 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.688210 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:04.688766 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:04.688768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.689181 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.689182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:04.689240 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:04.689770 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:04.689775 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:04.691757 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":85,"threads_started":1}
W20260811 16:43:04.691988 10833 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:04.686831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:33225 (local address 127.27.186.126:39811)
0811 16:43:04.686961 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:04.686964 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:04.687049 (+ 85us) server_negotiation.cc:407] Connection header received
0811 16:43:04.687112 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:04.687113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:04.687123 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:04.687188 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:04.687591 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.688106 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.688871 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.689072 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.689145 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:04.691894 (+ 2749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:33225: BlockingRecv error: recv got EOF from 127.27.186.65:33225 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
Aug 11 16:43:04 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:04 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:04.844494 10834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:04.839521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:50793)
0811 16:43:04.839674 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:04.839705 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:04.839771 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:04.839973 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:04.839974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:04.840166 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:04.840218 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:04.840220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.840941 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.840942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:04.841513 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:04.841515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.841921 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.841922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:04.841992 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:04.842481 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:04.842485 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:04.844392 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
W20260811 16:43:04.844545 10833 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:04.839666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:50793 (local address 127.27.186.126:39811)
0811 16:43:04.839740 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:04.839742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:04.839750 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:43:04.839857 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:04.839858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:04.839871 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:04.839962 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:04.840309 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.840829 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.841617 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.841825 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.841919 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:04.844475 (+ 2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:50793: BlockingRecv error: recv got EOF from 127.27.186.66:50793 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 16:43:04 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:04 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:04.990429 10836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:04.985032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:51773)
0811 16:43:04.985293 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:04.985308 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:04.985424 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:04.985637 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:04.985638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:04.985850 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:04.985903 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:04.985906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.986680 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.986681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:04.987302 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:04.987304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.987702 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.987703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:04.987769 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:04.988289 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:04.988295 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:04.990319 (+ 2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":138,"threads_started":1}
W20260811 16:43:04.990484 10833 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:04.985142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:51773 (local address 127.27.186.126:39811)
0811 16:43:04.985271 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:04.985273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:04.985400 (+ 127us) server_negotiation.cc:407] Connection header received
0811 16:43:04.985520 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:04.985522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:04.985540 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:04.985631 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:04.986000 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.986582 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.987401 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:04.987615 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:04.987704 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:04.990410 (+ 2706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:51773: BlockingRecv error: recv got EOF from 127.27.186.67:51773 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 11 16:43:05 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:05 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:05.701133 10839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:05.692499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:33361)
0811 16:43:05.692661 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:05.692677 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:05.692732 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:05.692913 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:05.692914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:05.693101 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:05.693154 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:05.693156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.694013 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.694015 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:05.694668 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:05.694670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.695111 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.695112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:05.695176 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:05.699091 (+ 3915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:05.699097 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:05.701067 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":100,"threads_started":1}
W20260811 16:43:05.701292 10840 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:05.692573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:33361 (local address 127.27.186.126:39811)
0811 16:43:05.692750 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:05.692755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:05.692771 (+ 16us) server_negotiation.cc:407] Connection header received
0811 16:43:05.692809 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:05.692810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:05.692821 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:05.692895 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:05.693242 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.693902 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.694772 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.695011 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.695112 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:05.701197 (+ 6085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:33361: BlockingRecv error: recv got EOF from 127.27.186.65:33361 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":121,"threads_started":1}
Aug 11 16:43:05 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:05 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:05.850518 10841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:05.845111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:42593)
0811 16:43:05.845335 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:05.845349 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:05.845501 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:05.845686 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:05.845687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:05.845882 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:05.845934 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:05.845936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.846648 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.846649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:05.847369 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:05.847372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.847829 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.847830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:05.847895 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:05.848385 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:05.848390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:05.850439 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":105,"threads_started":1}
W20260811 16:43:05.850680 10840 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:05.845252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:42593 (local address 127.27.186.126:39811)
0811 16:43:05.845339 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:05.845342 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:05.845437 (+ 95us) server_negotiation.cc:407] Connection header received
0811 16:43:05.845585 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:05.845587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:05.845600 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:05.845678 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:05.846035 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.846552 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.847539 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.847750 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.847829 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:05.850527 (+ 2698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:42593: BlockingRecv error: recv got EOF from 127.27.186.66:42593 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 16:43:05 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:05 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:05.995898 10843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:05.991082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:46305)
0811 16:43:05.991234 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:05.991253 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:05.991306 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:05.991498 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:05.991499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:05.991671 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:05.991725 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:05.991727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.992375 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.992376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:05.992923 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:05.992924 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.993250 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.993251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:05.993290 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:05.993790 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:05.993794 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:05.995791 (+ 1997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
W20260811 16:43:05.995998 10840 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:05.991183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:46305 (local address 127.27.186.126:39811)
0811 16:43:05.991360 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:05.991362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:05.991373 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:43:05.991406 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:05.991407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:05.991419 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:05.991478 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:05.991792 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.992297 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.992998 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:05.993182 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:05.993236 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:05.995899 (+ 2663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:46305: BlockingRecv error: recv got EOF from 127.27.186.67:46305 (error 108)
Metrics: {"server-negotiator.queue_time_us":151}
Aug 11 16:43:06 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:06 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:06.706758 10844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:06.701720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:43453)
0811 16:43:06.701867 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:06.701879 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:06.701932 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:06.702117 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:06.702118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:06.702285 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:06.702338 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:06.702339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.703021 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.703023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:06.703581 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:06.703583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.703949 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.703949 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:06.703993 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:06.704556 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:06.704561 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:06.706636 (+ 2075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
W20260811 16:43:06.706853 10845 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:06.701805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:43453 (local address 127.27.186.126:39811)
0811 16:43:06.701971 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:06.701973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:06.701987 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:43:06.702013 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:06.702013 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:06.702024 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:06.702096 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:06.702408 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.702926 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.703679 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.703879 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.703935 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:06.706755 (+ 2820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:43453: BlockingRecv error: recv got EOF from 127.27.186.65:43453 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
Aug 11 16:43:06 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:06 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:06.856488 10847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:06.851121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:48733)
0811 16:43:06.851351 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:06.851371 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:06.851451 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:06.851620 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:06.851621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:06.851835 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:06.851887 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:06.851889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.852649 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.852650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:06.853192 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:06.853193 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.853766 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.853767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:06.853833 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:06.854339 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:06.854345 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:06.856406 (+ 2061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":79,"threads_started":1}
W20260811 16:43:06.856627 10845 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:06.851304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:48733 (local address 127.27.186.126:39811)
0811 16:43:06.851381 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:06.851383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:06.851439 (+ 56us) server_negotiation.cc:407] Connection header received
0811 16:43:06.851506 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:06.851507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:06.851519 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:06.851572 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:06.851978 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.852560 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.853322 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.853667 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.853746 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:06.856543 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:48733: BlockingRecv error: recv got EOF from 127.27.186.66:48733 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 16:43:06 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:07 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:07.002133 10850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:06.996689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:49955)
0811 16:43:06.996867 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:06.996882 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:06.996960 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:06.997146 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:06.997147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:06.997405 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:06.997528 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:06.997531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.998502 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.998504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:06.999123 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:06.999127 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.999509 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.999510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:06.999551 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:07.000095 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:07.000099 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:07.002070 (+ 1971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":130,"threads_started":1}
W20260811 16:43:07.002368 10845 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:06.996793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:49955 (local address 127.27.186.126:39811)
0811 16:43:06.996866 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:06.996868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:06.996954 (+ 86us) server_negotiation.cc:407] Connection header received
0811 16:43:06.997043 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:06.997044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:06.997062 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:06.997108 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:06.997648 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.998371 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.999239 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:06.999428 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:06.999496 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:07.002257 (+ 2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:49955: BlockingRecv error: recv got EOF from 127.27.186.67:49955 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 16:43:07 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:07 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:07.712668 10852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:07.707380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:49173)
0811 16:43:07.707649 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:07.707662 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:07.707732 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:07.707959 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:07.707961 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:07.708150 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:07.708219 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:07.708221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:07.708934 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:07.708935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:07.709582 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:07.709585 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:07.709924 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:07.709925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:07.709965 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:07.710450 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:07.710454 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:07.712603 (+ 2149us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":100,"threads_started":1}
W20260811 16:43:07.712877 10853 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:07.707500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:49173 (local address 127.27.186.126:39811)
0811 16:43:07.707651 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:07.707653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:07.707729 (+ 76us) server_negotiation.cc:407] Connection header received
0811 16:43:07.707796 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:07.707797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:07.707808 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:07.707861 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:07.708287 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:07.708857 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:07.709660 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:07.709857 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:07.709923 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:07.712793 (+ 2870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:49173: BlockingRecv error: recv got EOF from 127.27.186.65:49173 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
Aug 11 16:43:07 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:07 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:07.862979 10854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:07.857146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:48029)
0811 16:43:07.857342 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:07.857355 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:07.857443 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:07.857637 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:07.857638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:07.857844 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:07.857901 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:07.857904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:07.859064 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:07.859065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:07.859754 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:07.859757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:07.860165 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:07.860167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:07.860222 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:07.860710 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:07.860715 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:07.862897 (+ 2182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":100,"threads_started":1}
W20260811 16:43:07.863106 10853 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:07.857293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:48029 (local address 127.27.186.126:39811)
0811 16:43:07.857370 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:07.857372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:07.857435 (+ 63us) server_negotiation.cc:407] Connection header received
0811 16:43:07.857543 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:07.857545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:07.857556 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:07.857608 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:07.857988 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:07.858874 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:07.859841 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:07.860049 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:07.860109 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:07.863019 (+ 2910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:48029: BlockingRecv error: recv got EOF from 127.27.186.66:48029 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 16:43:08 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:08 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:08.007851 10855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:08.002820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:40703)
0811 16:43:08.003005 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:08.003017 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:08.003099 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:08.003270 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:08.003272 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:08.003507 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:08.003559 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:08.003562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.004249 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.004251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:08.004801 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:08.004803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.005257 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.005258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:08.005328 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:08.005901 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:08.005906 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:08.007734 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":103,"threads_started":1}
W20260811 16:43:08.007889 10853 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:08.002901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:40703 (local address 127.27.186.126:39811)
0811 16:43:08.002997 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:08.002999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:08.003067 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:43:08.003169 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:08.003170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:08.003183 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:08.003260 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:08.003654 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.004161 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.004915 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.005162 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.005243 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:08.007820 (+ 2577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:40703: BlockingRecv error: recv got EOF from 127.27.186.67:40703 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 16:43:08 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:08 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:08.718701 10856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:08.713228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:49069)
0811 16:43:08.713425 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:08.713444 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:08.713556 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:08.713725 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:08.713726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:08.713907 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:08.713957 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:08.713959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.714773 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.714774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:08.715305 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:08.715307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.715687 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.715688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:08.715728 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:08.716261 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:08.716266 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:08.718586 (+ 2320us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":84,"threads_started":1}
W20260811 16:43:08.718874 10859 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:08.713298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:49069 (local address 127.27.186.126:39811)
0811 16:43:08.713533 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:08.713536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:08.713549 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:43:08.713626 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:08.713627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:08.713638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:08.713714 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:08.714053 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.714690 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.715398 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.715613 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.715681 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:08.718704 (+ 3023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:49069: BlockingRecv error: recv got EOF from 127.27.186.65:49069 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":100,"threads_started":1}
Aug 11 16:43:08 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:08 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:08.868538 10863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:08.863518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:49063)
0811 16:43:08.863658 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:08.863676 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:08.863739 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:08.863882 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:08.863882 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:08.864118 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:08.864173 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:08.864176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.864920 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.864921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:08.865465 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:08.865467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.865842 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.865843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:08.865888 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:08.866365 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:08.866370 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:08.868475 (+ 2105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
W20260811 16:43:08.868711 10859 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:08.863579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:49063 (local address 127.27.186.126:39811)
0811 16:43:08.863646 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:08.863648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:08.863731 (+ 83us) server_negotiation.cc:407] Connection header received
0811 16:43:08.863806 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:08.863807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:08.863818 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:08.863863 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:08.864236 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.864825 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.865589 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:08.865774 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:08.865831 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:08.868615 (+ 2784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:49063: BlockingRecv error: recv got EOF from 127.27.186.66:49063 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 16:43:09 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:09 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:09.013404 10864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:09.008385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:58267)
0811 16:43:09.008594 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:09.008609 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:09.008713 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:09.008888 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:09.008889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:09.009095 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:09.009151 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:09.009154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.009904 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.009905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:09.010467 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:09.010468 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.010833 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.010834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:09.010894 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:09.011417 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:09.011422 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:09.013342 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":105,"threads_started":1}
W20260811 16:43:09.013615 10859 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:09.008503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:58267 (local address 127.27.186.126:39811)
0811 16:43:09.008598 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:09.008601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:09.008692 (+ 91us) server_negotiation.cc:407] Connection header received
0811 16:43:09.008784 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:09.008785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:09.008806 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:09.008877 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:09.009243 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.009814 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.010563 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.010755 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.010834 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:09.013547 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:58267: BlockingRecv error: recv got EOF from 127.27.186.67:58267 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 16:43:09 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:09 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:09.724346 10865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:09.719213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:43521)
0811 16:43:09.719510 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:09.719522 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:09.719586 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:09.719775 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:09.719777 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:09.719971 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:09.720020 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:09.720023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.720734 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.720736 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:09.721259 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:09.721261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.721720 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.721721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:09.721793 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:09.722274 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:09.722280 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:09.724282 (+ 2002us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":196,"threads_started":1}
W20260811 16:43:09.724591 10867 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:09.719422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:43521 (local address 127.27.186.126:39811)
0811 16:43:09.719605 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:09.719608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:09.719620 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:43:09.719650 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:09.719651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:09.719664 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:09.719764 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:09.720110 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.720633 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.721356 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.721643 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.721720 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:09.724425 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:43521: BlockingRecv error: recv got EOF from 127.27.186.65:43521 (error 108)
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":114,"threads_started":1}
Aug 11 16:43:09 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:09 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:09.874547 10868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:09.869070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:50681)
0811 16:43:09.869237 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:09.869248 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:09.869312 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:09.869492 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:09.869493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:09.869668 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:09.869720 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:09.869722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.870497 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.870499 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:09.871275 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:09.871278 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.871721 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.871722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:09.871768 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:09.872282 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:09.872306 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:09.874485 (+ 2179us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
W20260811 16:43:09.874621 10867 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:09.869182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:50681 (local address 127.27.186.126:39811)
0811 16:43:09.869263 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:09.869265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:09.869298 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:43:09.869379 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:09.869380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:09.869390 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:09.869453 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:09.869794 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.870354 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.871391 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:09.871643 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:09.871708 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:09.874571 (+ 2863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:50681: BlockingRecv error: recv got EOF from 127.27.186.66:50681 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 16:43:10 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:10 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:10.019613 10869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:10.014109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:41271)
0811 16:43:10.014302 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:10.014318 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:10.014393 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:10.014590 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:10.014591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:10.014776 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:10.014844 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:10.014846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.015586 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.015587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:10.016172 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:10.016174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.016590 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.016592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:10.016645 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:10.017283 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:10.017289 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:10.019549 (+ 2260us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":96,"threads_started":1}
W20260811 16:43:10.019781 10867 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:10.014274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:41271 (local address 127.27.186.126:39811)
0811 16:43:10.014359 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:10.014361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:10.014376 (+ 15us) server_negotiation.cc:407] Connection header received
0811 16:43:10.014460 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:10.014461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:10.014474 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:10.014537 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:10.014960 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.015483 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.016277 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.016481 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.016548 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:10.019706 (+ 3158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:41271: BlockingRecv error: recv got EOF from 127.27.186.67:41271 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 16:43:10 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:10 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:10.735872 10870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:10.724909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:51181)
0811 16:43:10.725068 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:10.725081 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:10.725156 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:10.725344 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:10.725346 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:10.725603 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:10.725685 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:10.725688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.726649 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.726650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:10.727545 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:10.727550 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.728083 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.728084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:10.728128 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:10.733838 (+ 5710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:10.733845 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:10.735762 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
W20260811 16:43:10.735970 10872 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:10.724955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:51181 (local address 127.27.186.126:39811)
0811 16:43:10.725128 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:10.725130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:10.725139 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:43:10.725222 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:10.725223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:10.725234 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:10.725295 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:10.725794 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.726536 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.727666 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.727987 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.728068 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:10.735883 (+ 7815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:51181: BlockingRecv error: recv got EOF from 127.27.186.65:51181 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
Aug 11 16:43:10 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:10 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:10.880095 10873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:10.875205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:51313)
0811 16:43:10.875377 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:10.875390 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:10.875484 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:10.875628 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:10.875630 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:10.875822 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:10.875871 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:10.875872 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.876593 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.876594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:10.877180 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:10.877182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.877591 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.877592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:10.877639 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:10.878202 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:10.878207 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:10.880021 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":94,"threads_started":1}
W20260811 16:43:10.880172 10872 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:10.875294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:51313 (local address 127.27.186.126:39811)
0811 16:43:10.875349 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:10.875351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:10.875467 (+ 116us) server_negotiation.cc:407] Connection header received
0811 16:43:10.875533 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:10.875534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:10.875546 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:10.875603 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:10.875984 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.876504 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.877269 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:10.877460 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:10.877580 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:10.880121 (+ 2541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:51313: BlockingRecv error: recv got EOF from 127.27.186.66:51313 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 16:43:11 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:11 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:11.024750 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:11.020092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:43591)
0811 16:43:11.020280 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:11.020294 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:11.020353 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:11.020508 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:11.020508 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:11.020691 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:11.020743 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:11.020745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.021391 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.021391 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:11.022010 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:11.022013 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.022347 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.022348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:11.022389 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:11.022839 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:11.022844 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:11.024678 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":108,"threads_started":1}
W20260811 16:43:11.024897 10872 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:11.020164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:43591 (local address 127.27.186.126:39811)
0811 16:43:11.020256 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:11.020258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:11.020358 (+ 100us) server_negotiation.cc:407] Connection header received
0811 16:43:11.020422 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:11.020422 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:11.020435 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:11.020482 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:11.020810 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.021301 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.022093 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.022279 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.022336 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:11.024809 (+ 2473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:43591: BlockingRecv error: recv got EOF from 127.27.186.67:43591 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 16:43:11 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:11 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:11.741680 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:11.736412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:60463)
0811 16:43:11.736588 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:11.736599 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:11.736658 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:11.736816 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:11.736816 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:11.737012 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:11.737060 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:11.737062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.737897 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.737898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:11.738476 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:11.738478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.739075 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.739076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:11.739147 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:11.739640 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:11.739644 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:11.741608 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":107,"threads_started":1}
W20260811 16:43:11.741780 10879 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:11.736528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:60463 (local address 127.27.186.126:39811)
0811 16:43:11.736690 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:11.736692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:11.736701 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:43:11.736725 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:11.736726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:11.736736 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:11.736797 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:11.737167 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.737820 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.738596 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.738956 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.739052 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:11.741706 (+ 2654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:60463: BlockingRecv error: recv got EOF from 127.27.186.65:60463 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
Aug 11 16:43:11 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:11 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:11.885468 10881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:11.880599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:40385)
0811 16:43:11.880799 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:11.880811 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:11.880889 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:11.881053 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:11.881054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:11.881254 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:11.881301 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:11.881303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.882151 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.882152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:11.882701 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:11.882703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.883075 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.883076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:11.883165 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:11.883615 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:11.883620 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:11.885387 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":101,"threads_started":1}
W20260811 16:43:11.885603 10879 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:11.880691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:40385 (local address 127.27.186.126:39811)
0811 16:43:11.880776 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:11.880779 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:11.880880 (+ 101us) server_negotiation.cc:407] Connection header received
0811 16:43:11.880956 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:11.880957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:11.880976 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:11.881044 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:11.881385 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.882064 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.882790 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:11.882996 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:11.883075 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:11.885537 (+ 2462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:40385: BlockingRecv error: recv got EOF from 127.27.186.66:40385 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 16:43:12 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:12 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:12.029970 10882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:12.025297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:44815)
0811 16:43:12.025523 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:12.025538 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:12.025608 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:12.025739 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:12.025740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:12.025933 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:12.025984 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:12.025986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.026634 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.026635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:12.027180 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:12.027181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.027504 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.027504 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:12.027545 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:12.028047 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:12.028052 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:12.029902 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":95,"threads_started":1}
W20260811 16:43:12.030252 10879 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:12.025374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:44815 (local address 127.27.186.126:39811)
0811 16:43:12.025453 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:12.025455 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:12.025609 (+ 154us) server_negotiation.cc:407] Connection header received
0811 16:43:12.025652 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:12.025653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:12.025666 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:12.025726 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:12.026052 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.026555 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.027253 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.027436 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.027495 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:12.030201 (+ 2706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:44815: BlockingRecv error: recv got EOF from 127.27.186.67:44815 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 16:43:12 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:12 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:12.747054 10883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:12.742226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:59361)
0811 16:43:12.742409 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:12.742422 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:12.742497 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:12.742649 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:12.742650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:12.742825 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:12.742877 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:12.742879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.743548 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.743549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:12.744086 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:12.744088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.744408 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.744409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:12.744450 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:12.744933 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:12.744938 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:12.746952 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":130,"threads_started":1}
W20260811 16:43:12.747128 10884 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:12.742303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:59361 (local address 127.27.186.126:39811)
0811 16:43:12.742447 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:12.742449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:12.742479 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:43:12.742550 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:12.742551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:12.742563 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:12.742629 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:12.742949 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.743477 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.744155 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.744342 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.744391 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:12.747053 (+ 2662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:59361: BlockingRecv error: recv got EOF from 127.27.186.65:59361 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
Aug 11 16:43:12 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:12 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:12.891069 10888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:12.886103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:46059)
0811 16:43:12.886299 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:12.886313 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:12.886391 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:12.886589 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:12.886590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:12.886788 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:12.886836 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:12.886837 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.887539 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.887540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:12.888115 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:12.888117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.888502 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.888503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:12.888572 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:12.889063 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:12.889067 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:12.890952 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":78,"threads_started":1}
W20260811 16:43:12.891103 10884 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:12.886250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:46059 (local address 127.27.186.126:39811)
0811 16:43:12.886323 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:12.886325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:12.886369 (+ 44us) server_negotiation.cc:407] Connection header received
0811 16:43:12.886490 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:12.886491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:12.886506 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:12.886580 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:12.886922 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.887448 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.888208 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:12.888414 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:12.888503 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:12.891033 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:46059: BlockingRecv error: recv got EOF from 127.27.186.66:46059 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 16:43:13 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:13 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:13.036130 10890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:13.030680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:55337)
0811 16:43:13.030879 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:13.030892 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:13.030971 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:13.031237 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:13.031239 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:13.031478 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:13.031543 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:13.031547 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.032298 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.032300 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:13.032870 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:13.032873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.033289 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.033291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:13.033366 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:13.034126 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:13.034131 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:13.036046 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":98,"threads_started":1}
W20260811 16:43:13.036478 10884 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:13.030813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:55337 (local address 127.27.186.126:39811)
0811 16:43:13.030909 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:13.030911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:13.030951 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:43:13.031095 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:13.031096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:13.031111 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:13.031178 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:13.031669 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.032203 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.032979 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.033187 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.033284 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:13.036380 (+ 3096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:55337: BlockingRecv error: recv got EOF from 127.27.186.67:55337 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 16:43:13 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:13 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:13.752326 10893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:13.747671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:46171)
0811 16:43:13.747834 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:13.747850 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:13.747900 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:13.748064 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:13.748065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:13.748235 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:13.748286 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:13.748287 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.748938 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.748938 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:13.749512 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:13.749514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.749851 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.749852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:13.749893 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:13.750418 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:13.750422 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:13.752262 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
W20260811 16:43:13.752454 10897 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:13.747778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:46171 (local address 127.27.186.126:39811)
0811 16:43:13.747914 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:13.747916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:13.747944 (+ 28us) server_negotiation.cc:407] Connection header received
0811 16:43:13.747975 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:13.747976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:13.747986 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:13.748040 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:13.748357 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.748870 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.749578 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.749772 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.749837 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:13.752366 (+ 2529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:46171: BlockingRecv error: recv got EOF from 127.27.186.65:46171 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
Aug 11 16:43:13 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:13 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:13.896320 10899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:13.891548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:42777)
0811 16:43:13.891761 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:13.891775 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:13.891840 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:13.891979 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:13.891980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:13.892160 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:13.892211 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:13.892212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.892849 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.892849 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:13.893379 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:13.893381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.893725 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.893726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:13.893772 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:13.894244 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:13.894248 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:13.896256 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":113,"threads_started":1}
W20260811 16:43:13.896488 10897 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:13.891645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:42777 (local address 127.27.186.126:39811)
0811 16:43:13.891721 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:13.891723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:13.891840 (+ 117us) server_negotiation.cc:407] Connection header received
0811 16:43:13.891890 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:13.891891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:13.891902 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:13.891954 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:13.892284 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.892779 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.893452 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:13.893660 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:13.893712 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:13.896386 (+ 2674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:42777: BlockingRecv error: recv got EOF from 127.27.186.66:42777 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 16:43:14 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:14 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.67@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:14.042192 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:14.036732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.67:44957)
0811 16:43:14.036903 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:14.036947 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:14.037016 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:14.037200 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:14.037201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:14.037396 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:14.037456 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:14.037458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.038191 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.038192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:14.038727 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:14.038728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.039130 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.039131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:14.039194 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:14.039695 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:14.039701 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:14.042082 (+ 2381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":72,"threads_started":1}
W20260811 16:43:14.042251 10897 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:14.036889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:44957 (local address 127.27.186.126:39811)
0811 16:43:14.036993 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:14.036996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:14.037009 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:43:14.037104 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:14.037105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:14.037118 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:14.037190 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:14.037577 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.038097 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.038820 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.039043 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.039127 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:14.042181 (+ 3054us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.67:44957: BlockingRecv error: recv got EOF from 127.27.186.67:44957 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 16:43:14 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:14 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.65@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:14.757664 10901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:14.752976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.65:35033)
0811 16:43:14.753129 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:14.753143 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:14.753208 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:14.753346 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:14.753346 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:14.753579 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:14.753630 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:14.753632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.754312 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.754313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:14.754855 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:14.754857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.755228 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.755229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:14.755274 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:14.755815 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:14.755820 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:14.757594 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
W20260811 16:43:14.757762 10902 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:14.753021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:35033 (local address 127.27.186.126:39811)
0811 16:43:14.753202 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:14.753204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:14.753214 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:43:14.753265 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:14.753266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:14.753277 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:14.753327 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:14.753714 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.754232 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.754946 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.755156 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.755214 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:14.757688 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.65:35033: BlockingRecv error: recv got EOF from 127.27.186.65:35033 (error 108)
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":93,"threads_started":1}
Aug 11 16:43:14 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 16:43:14 dist-test-slave-gsp7 krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.27.186.66@KRBTEST.COM for oryx/127.27.186.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 16:43:14.902987 10903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:14.896950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39811 (local address 127.27.186.66:52791)
0811 16:43:14.897151 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:14.897164 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:14.897302 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:14.897539 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:14.897540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:14.897747 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:14.897802 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:14.897804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.898635 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.898639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:14.899255 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:14.899257 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.899665 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.899666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:14.899740 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:14.900244 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:14.900249 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:14.902880 (+ 2631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.27.186.126:39811: Server oryx/127.27.186.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":120,"threads_started":1}
W20260811 16:43:14.903035 10902 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:14.897041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:52791 (local address 127.27.186.126:39811)
0811 16:43:14.897129 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:14.897132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:14.897291 (+ 159us) server_negotiation.cc:407] Connection header received
0811 16:43:14.897405 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:14.897406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:14.897427 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:14.897531 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:14.897893 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.898533 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.899351 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:14.899578 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:14.899667 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:14.902986 (+ 3319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.27.186.66:52791: BlockingRecv error: recv got EOF from 127.27.186.66:52791 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 16:43:14.955541 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 10076
I20260811 16:43:14.968266 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 10330
I20260811 16:43:14.989429 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 10568
I20260811 16:43:14.997684 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 9941
2026-08-11T16:43:15Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17897 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T16:43:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:43:15Z Disabled control of system clock
I20260811 16:43:15.033648 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41033
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:37917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:41033
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 16:43:15.116272 10911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:15.116494 10911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:15.116516 10911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:15.117676 10911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:43:15.117712 10911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:15.117725 10911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:15.117738 10911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:43:15.117749 10911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:43:15.119063 10911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:41033
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:15.119270 10911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:15.119516 10911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:15.124575 10923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.124575 10918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.124667 10911 server_base.cc:1034] running on GCE node
W20260811 16:43:15.124583 10916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.125108 10911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:15.125422 10911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:15.126596 10911 hybrid_clock.cc:648] HybridClock initialized: now 1786466595126570 us; error 40 us; skew 500 ppm
I20260811 16:43:15.127941 10911 webserver.cc:460] Webserver started at http://127.27.186.126:45435/ using document root <none> and password file <none>
I20260811 16:43:15.128209 10911 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:15.128258 10911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:15.128433 10911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:15.129799 10911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "a940db6aa32a42c6a9c5dcb87550165a"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "27cb4639582e85a6eb6c9a4e98207311"
server_key_iv: "43d9962148b9cd9fe49fc1e5fc2ab40b"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.130192 10911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "a940db6aa32a42c6a9c5dcb87550165a"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "27cb4639582e85a6eb6c9a4e98207311"
server_key_iv: "43d9962148b9cd9fe49fc1e5fc2ab40b"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.131573 10911 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:43:15.132469 10934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.132659 10911 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:43:15.132772 10911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "a940db6aa32a42c6a9c5dcb87550165a"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "27cb4639582e85a6eb6c9a4e98207311"
server_key_iv: "43d9962148b9cd9fe49fc1e5fc2ab40b"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.132870 10911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:15.152941 10911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:15.153520 10911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:15.153734 10911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:15.158355 10911 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:41033
I20260811 16:43:15.158470 11029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:41033 every 8 connection(s)
I20260811 16:43:15.158814 10911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:43:15.159508 11030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:43:15.162230 11030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a: Bootstrap starting.
I20260811 16:43:15.162858 11030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a: Neither blocks nor log segments found. Creating new log.
I20260811 16:43:15.163167 11030 log.cc:824] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:43:15.163875 11030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a: No bootstrap required, opened a new log
I20260811 16:43:15.165458 11030 raft_consensus.cc:348] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a940db6aa32a42c6a9c5dcb87550165a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41033 } }
I20260811 16:43:15.165814 11030 raft_consensus.cc:374] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:43:15.165904 11030 raft_consensus.cc:729] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a940db6aa32a42c6a9c5dcb87550165a, State: Initialized, Role: FOLLOWER
I20260811 16:43:15.166087 11030 consensus_queue.cc:260] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a940db6aa32a42c6a9c5dcb87550165a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41033 } }
I20260811 16:43:15.166184 11030 raft_consensus.cc:388] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:43:15.166210 11030 raft_consensus.cc:482] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:43:15.166280 11030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:43:15.166880 11030 raft_consensus.cc:504] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a940db6aa32a42c6a9c5dcb87550165a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41033 } }
I20260811 16:43:15.166999 11030 leader_election.cc:302] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a940db6aa32a42c6a9c5dcb87550165a; no voters:
I20260811 16:43:15.167191 11030 leader_election.cc:288] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:43:15.167243 11033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:43:15.167452 11033 raft_consensus.cc:686] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [term 1 LEADER]: Becoming Leader. State: Replica: a940db6aa32a42c6a9c5dcb87550165a, State: Running, Role: LEADER
I20260811 16:43:15.167481 11030 sys_catalog.cc:564] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:43:15.167645 11033 consensus_queue.cc:237] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a940db6aa32a42c6a9c5dcb87550165a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41033 } }
I20260811 16:43:15.168073 11040 sys_catalog.cc:455] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a940db6aa32a42c6a9c5dcb87550165a. Latest consensus state: current_term: 1 leader_uuid: "a940db6aa32a42c6a9c5dcb87550165a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a940db6aa32a42c6a9c5dcb87550165a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41033 } } }
I20260811 16:43:15.168196 11040 sys_catalog.cc:458] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [sys.catalog]: This master's current role is: LEADER
I20260811 16:43:15.168257 11034 sys_catalog.cc:455] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a940db6aa32a42c6a9c5dcb87550165a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a940db6aa32a42c6a9c5dcb87550165a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41033 } } }
I20260811 16:43:15.168426 11034 sys_catalog.cc:458] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a [sys.catalog]: This master's current role is: LEADER
I20260811 16:43:15.168498 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 10911
I20260811 16:43:15.168591 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:43:15.168684 11052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:43:15.168797 28393 external_mini_cluster.cc:1428] Setting key 0de16c137204af8cc146b064b20a593b
I20260811 16:43:15.169384 11052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:43:15.171198 11052 catalog_manager.cc:1347] Generated new cluster ID: 44ec7344de05461eb99289984281e9da
I20260811 16:43:15.171255 11052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:43:15.175329 11052 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:43:15.176059 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.169696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45070 (local address 127.27.186.126:41033)
0811 16:43:15.170118 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:15.170128 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:15.170160 (+ 32us) server_negotiation.cc:407] Connection header received
0811 16:43:15.170279 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:15.170286 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:15.170354 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:15.170503 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:15.170875 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.172000 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.173048 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.173788 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.173922 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:15.175040 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:15.175045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:15.175045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:43:15.175300 (+ 255us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:15.175354 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:43:15.175372 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:15.175459 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:15.175699 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 16:43:15.175802 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":72,"threads_started":1}
I20260811 16:43:15.176949 11052 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:43:15.183857 11052 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a940db6aa32a42c6a9c5dcb87550165a: Generated new TSK 0
I20260811 16:43:15.184053 11052 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:43:15.189229 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41033
--builtin_ntp_servers=127.27.186.84:37917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 16:43:15.279677 11078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:15.279908 11078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:15.279944 11078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:15.281102 11078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:15.281165 11078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:15.281209 11078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:43:15.282616 11078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:15.282881 11078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:15.283181 11078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:15.288359 11086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.288386 11090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.288604 11087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.288687 11078 server_base.cc:1034] running on GCE node
I20260811 16:43:15.288985 11078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:15.289271 11078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:15.290469 11078 hybrid_clock.cc:648] HybridClock initialized: now 1786466595290452 us; error 42 us; skew 500 ppm
I20260811 16:43:15.291960 11078 webserver.cc:460] Webserver started at http://127.27.186.65:45293/ using document root <none> and password file <none>
I20260811 16:43:15.292232 11078 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:15.292300 11078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:15.292454 11078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:15.293877 11078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "4430532635f94b2d80afbafd8427abc7"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "84acbb101587d9246de2ea5eb4fe6379"
server_key_iv: "848929b7cb84935a7d9f3c661c279f70"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.294265 11078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "4430532635f94b2d80afbafd8427abc7"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "84acbb101587d9246de2ea5eb4fe6379"
server_key_iv: "848929b7cb84935a7d9f3c661c279f70"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.295821 11078 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:43:15.296693 11100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.296890 11078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:43:15.296983 11078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "4430532635f94b2d80afbafd8427abc7"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "84acbb101587d9246de2ea5eb4fe6379"
server_key_iv: "848929b7cb84935a7d9f3c661c279f70"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.297052 11078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:15.316963 11078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:15.317345 11078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:15.317545 11078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:15.317826 11078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:15.318219 11078 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:15.318262 11078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.318287 11078 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:15.318300 11078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.324390 11078 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:34265
I20260811 16:43:15.324458 11304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:34265 every 8 connection(s)
I20260811 16:43:15.324792 11078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:43:15.326947 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 11078
I20260811 16:43:15.327030 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:43:15.327240 28393 external_mini_cluster.cc:1428] Setting key ae86913a3fadf30e47c8c0749ed44953
I20260811 16:43:15.328193 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41033
--builtin_ntp_servers=127.27.186.84:37917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 16:43:15.330597 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.325611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:44223 (local address 127.27.186.126:41033)
0811 16:43:15.325658 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:15.325660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:15.325896 (+ 236us) server_negotiation.cc:407] Connection header received
0811 16:43:15.326394 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:15.326396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:15.326408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:15.326457 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:15.327195 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.327850 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.328974 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.329288 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.329364 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:15.330307 (+ 943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:15.330308 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:15.330308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:43:15.330313 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:15.330327 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:43:15.330339 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:15.330391 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:15.330492 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 16:43:15.330520 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:43:15.330844 11309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.325601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41033 (local address 127.27.186.65:44223)
0811 16:43:15.325768 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:15.325802 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:15.326297 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:15.326525 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:15.326529 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:15.326536 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:15.327119 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:15.327125 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.327938 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.327939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:15.328860 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:15.328864 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.329378 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.329379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:15.329567 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:15.330150 (+ 583us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:43:15.330150 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:15.330178 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:43:15.330200 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:15.330398 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:15.330404 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:15.330406 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:43:15.330493 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 16:43:15.330593 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":75,"threads_started":1}
I20260811 16:43:15.331380 11306 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41033
I20260811 16:43:15.331488 11306 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:15.331666 11306 heartbeater.cc:511] Master 127.27.186.126:41033 requested a full tablet report, sending...
I20260811 16:43:15.332259 10960 ts_manager.cc:194] Registered new tserver with Master: 4430532635f94b2d80afbafd8427abc7 (127.27.186.65:34265)
I20260811 16:43:15.333241 10960 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.65:44223
W20260811 16:43:15.415413 11310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:15.415634 11310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:15.415657 11310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:15.416742 11310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:15.416781 11310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:15.416807 11310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:43:15.418103 11310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:15.418377 11310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:15.418709 11310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:15.424193 11322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.424244 11324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.424232 11310 server_base.cc:1034] running on GCE node
W20260811 16:43:15.424360 11331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.424592 11310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:15.424850 11310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:15.426014 11310 hybrid_clock.cc:648] HybridClock initialized: now 1786466595426010 us; error 37 us; skew 500 ppm
I20260811 16:43:15.427322 11310 webserver.cc:460] Webserver started at http://127.27.186.66:40931/ using document root <none> and password file <none>
I20260811 16:43:15.427592 11310 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:15.427670 11310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:15.427817 11310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:15.428961 11310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "58ab1e3eefa24d9880a5a8c88ce969af"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "40c888c51c8e6983821646f7f3b2d3be"
server_key_iv: "0a51f778d9d9e47e6ca2bffd1ea93bd5"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.429425 11310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "58ab1e3eefa24d9880a5a8c88ce969af"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "40c888c51c8e6983821646f7f3b2d3be"
server_key_iv: "0a51f778d9d9e47e6ca2bffd1ea93bd5"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.430816 11310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:43:15.431567 11341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.431738 11310 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:43:15.431843 11310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "58ab1e3eefa24d9880a5a8c88ce969af"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "40c888c51c8e6983821646f7f3b2d3be"
server_key_iv: "0a51f778d9d9e47e6ca2bffd1ea93bd5"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.431927 11310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:15.448449 11310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:15.448805 11310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:15.448968 11310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:15.449222 11310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:15.449636 11310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:15.449693 11310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.449735 11310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:15.449764 11310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.456066 11310 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:36231
I20260811 16:43:15.456185 11550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:36231 every 8 connection(s)
I20260811 16:43:15.456498 11310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:43:15.461716 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.457230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:33723 (local address 127.27.186.126:41033)
0811 16:43:15.457306 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:15.457308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:15.457607 (+ 299us) server_negotiation.cc:407] Connection header received
0811 16:43:15.458140 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:15.458141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:15.458151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:15.458205 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:15.458873 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.459388 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.460345 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.460538 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.460589 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:15.461367 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:15.461368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:15.461369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:43:15.461373 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:15.461386 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:43:15.461390 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:15.461433 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:15.461611 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 16:43:15.461639 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:43:15.461954 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.457229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41033 (local address 127.27.186.66:33723)
0811 16:43:15.457432 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:15.457468 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:15.458043 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:15.458263 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:15.458266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:15.458275 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:15.458785 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:15.458789 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.459478 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.459479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:15.460265 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:15.460268 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.460617 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.460618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:15.460725 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:15.461234 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:43:15.461234 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:15.461262 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:43:15.461286 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:15.461447 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:15.461451 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:15.461454 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:43:15.461610 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 16:43:15.461696 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260811 16:43:15.462520 11551 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41033
I20260811 16:43:15.462620 11551 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:15.462822 11551 heartbeater.cc:511] Master 127.27.186.126:41033 requested a full tablet report, sending...
I20260811 16:43:15.463222 10960 ts_manager.cc:194] Registered new tserver with Master: 58ab1e3eefa24d9880a5a8c88ce969af (127.27.186.66:36231)
I20260811 16:43:15.463562 10960 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.66:33723
I20260811 16:43:15.464551 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 11310
I20260811 16:43:15.464659 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:43:15.464845 28393 external_mini_cluster.cc:1428] Setting key 6ae2a2ef36a443a9a83c6cddd998f994
I20260811 16:43:15.465767 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41033
--builtin_ntp_servers=127.27.186.84:37917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 16:43:15.552299 11555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:15.552556 11555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:15.552580 11555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:15.553792 11555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:15.553833 11555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:15.553858 11555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:43:15.555245 11555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:15.555505 11555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:15.555819 11555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:15.561056 11568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.561084 11574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.561174 11555 server_base.cc:1034] running on GCE node
W20260811 16:43:15.561136 11567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.561616 11555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:15.561857 11555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:15.563004 11555 hybrid_clock.cc:648] HybridClock initialized: now 1786466595562992 us; error 28 us; skew 500 ppm
I20260811 16:43:15.564356 11555 webserver.cc:460] Webserver started at http://127.27.186.67:35309/ using document root <none> and password file <none>
I20260811 16:43:15.564610 11555 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:15.564658 11555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:15.564827 11555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:15.565970 11555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "8c17b8aa4ba64d0a9b1314bc9580ffbf"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "ef166d7f85ffab43c4fa7de770fcd5a8"
server_key_iv: "bec6317d9d5f832ed78a4a0811c3a5e8"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.566332 11555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "8c17b8aa4ba64d0a9b1314bc9580ffbf"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "ef166d7f85ffab43c4fa7de770fcd5a8"
server_key_iv: "bec6317d9d5f832ed78a4a0811c3a5e8"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.567652 11555 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:43:15.568462 11585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.568706 11555 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:43:15.568782 11555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "8c17b8aa4ba64d0a9b1314bc9580ffbf"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "ef166d7f85ffab43c4fa7de770fcd5a8"
server_key_iv: "bec6317d9d5f832ed78a4a0811c3a5e8"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.568867 11555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:15.583666 11555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:15.583969 11555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:15.584120 11555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:15.584349 11555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:15.584688 11555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:15.584723 11555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.584765 11555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:15.584793 11555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.591056 11555 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:42257
I20260811 16:43:15.591136 11799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:42257 every 8 connection(s)
I20260811 16:43:15.591467 11555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:43:15.591833 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 11555
I20260811 16:43:15.591955 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:43:15.592159 28393 external_mini_cluster.cc:1428] Setting key c53c4755afd58169eed057cd5ad6ff82
I20260811 16:43:15.597090 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.592241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:46451 (local address 127.27.186.126:41033)
0811 16:43:15.592298 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:15.592301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:15.592693 (+ 392us) server_negotiation.cc:407] Connection header received
0811 16:43:15.593343 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:15.593344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:15.593357 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:15.593408 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:15.594151 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.594659 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.595704 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.595924 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.596008 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:15.596782 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:15.596784 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:15.596784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:43:15.596789 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:15.596803 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:43:15.596807 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:15.596856 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:15.596976 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 16:43:15.597010 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:43:15.597318 11808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.592213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41033 (local address 127.27.186.67:46451)
0811 16:43:15.592558 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:15.592601 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:15.593237 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:15.593505 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:15.593509 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:15.593519 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:15.594043 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:15.594048 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.594758 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.594759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:15.595608 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:15.595611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:15.596017 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:15.596019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:15.596151 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:15.596633 (+ 482us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:43:15.596633 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:15.596661 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:43:15.596682 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:15.596866 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:15.596871 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:15.596874 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:43:15.596977 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:43:15.597077 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":89,"threads_started":1}
I20260811 16:43:15.597790 11802 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41033
I20260811 16:43:15.597874 11802 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:15.598102 11802 heartbeater.cc:511] Master 127.27.186.126:41033 requested a full tablet report, sending...
I20260811 16:43:15.598562 10960 ts_manager.cc:194] Registered new tserver with Master: 8c17b8aa4ba64d0a9b1314bc9580ffbf (127.27.186.67:42257)
I20260811 16:43:15.598969 10960 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.67:46451
I20260811 16:43:15.603976 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:43:15.605986 11061 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:15.605368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47802 (local address 127.27.186.126:41033)
0811 16:43:15.605438 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:15.605440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:15.605657 (+ 217us) server_negotiation.cc:407] Connection header received
0811 16:43:15.605698 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:15.605698 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:15.605710 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:15.605758 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:15.605892 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47802: BlockingRecv error: recv got EOF from 127.0.0.1:47802 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:43:15.606019 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 11078
I20260811 16:43:15.621752 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 11310
I20260811 16:43:15.635149 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 11555
I20260811 16:43:15.651448 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 10911
2026-08-11T16:43:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (650 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T16:43:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:43:15Z Disabled control of system clock
I20260811 16:43:15.684504 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:37873
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:38227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:37873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:43:15.768841 11820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:15.769094 11820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:15.769117 11820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:15.770279 11820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:43:15.770318 11820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:15.770330 11820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:15.770342 11820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:43:15.770354 11820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:43:15.771747 11820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:37873
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:37873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:15.771946 11820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:15.772205 11820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:43:15.777230 11820 server_base.cc:1034] running on GCE node
W20260811 16:43:15.777230 11836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.777257 11839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.777271 11835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.777753 11820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:15.778064 11820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:15.779206 11820 hybrid_clock.cc:648] HybridClock initialized: now 1786466595779190 us; error 28 us; skew 500 ppm
I20260811 16:43:15.784561 11820 webserver.cc:460] Webserver started at http://127.27.186.126:44795/ using document root <none> and password file <none>
I20260811 16:43:15.784847 11820 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:15.784899 11820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:15.785072 11820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:15.786406 11820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "a86f653b06014ffd8a3ef211aa292eee"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "2b176e0b82ad1e85d1987d43183fcd59"
server_key_iv: "0aec32536f0f6cda14295ce3166e06c5"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.787818 11820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "a86f653b06014ffd8a3ef211aa292eee"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "2b176e0b82ad1e85d1987d43183fcd59"
server_key_iv: "0aec32536f0f6cda14295ce3166e06c5"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.789259 11820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:43:15.790086 11850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.790360 11820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:43:15.790462 11820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "a86f653b06014ffd8a3ef211aa292eee"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "2b176e0b82ad1e85d1987d43183fcd59"
server_key_iv: "0aec32536f0f6cda14295ce3166e06c5"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.790526 11820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:15.793967 11820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:15.794219 11820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:15.794320 11820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:15.798345 11820 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:37873
I20260811 16:43:15.798377 11943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:37873 every 8 connection(s)
I20260811 16:43:15.798732 11820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:43:15.799376 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 11820
I20260811 16:43:15.799389 11945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:43:15.799458 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:43:15.799674 28393 external_mini_cluster.cc:1428] Setting key 013d4421a88734affbb257693215e773
I20260811 16:43:15.802924 11950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.800324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53716 (local address 127.27.186.126:37873)
0811 16:43:15.800566 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:15.800575 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:15.800610 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:43:15.801455 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:15.801465 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:15.801547 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:15.801701 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:15.802421 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:15.802425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:15.802425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:43:15.802430 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:15.802477 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:43:15.802491 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:15.802569 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:15.802673 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 16:43:15.802732 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":100,"threads_started":1}
I20260811 16:43:15.803925 11945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee: Bootstrap starting.
I20260811 16:43:15.804527 11945 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee: Neither blocks nor log segments found. Creating new log.
I20260811 16:43:15.804838 11945 log.cc:824] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee: Log is configured to *not* fsync() on all Append() calls
I20260811 16:43:15.805635 11945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee: No bootstrap required, opened a new log
I20260811 16:43:15.807137 11945 raft_consensus.cc:348] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a86f653b06014ffd8a3ef211aa292eee" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37873 } }
I20260811 16:43:15.807278 11945 raft_consensus.cc:374] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:43:15.807300 11945 raft_consensus.cc:729] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86f653b06014ffd8a3ef211aa292eee, State: Initialized, Role: FOLLOWER
I20260811 16:43:15.807443 11945 consensus_queue.cc:260] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a86f653b06014ffd8a3ef211aa292eee" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37873 } }
I20260811 16:43:15.807520 11945 raft_consensus.cc:388] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:43:15.807564 11945 raft_consensus.cc:482] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:43:15.807612 11945 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:43:15.808368 11945 raft_consensus.cc:504] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a86f653b06014ffd8a3ef211aa292eee" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37873 } }
I20260811 16:43:15.808504 11945 leader_election.cc:302] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a86f653b06014ffd8a3ef211aa292eee; no voters:
I20260811 16:43:15.808681 11945 leader_election.cc:288] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:43:15.808965 11945 sys_catalog.cc:564] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:43:15.809010 11952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:43:15.809212 11952 raft_consensus.cc:686] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [term 1 LEADER]: Becoming Leader. State: Replica: a86f653b06014ffd8a3ef211aa292eee, State: Running, Role: LEADER
I20260811 16:43:15.809363 11952 consensus_queue.cc:237] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a86f653b06014ffd8a3ef211aa292eee" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37873 } }
I20260811 16:43:15.809856 11956 sys_catalog.cc:455] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [sys.catalog]: SysCatalogTable state changed. Reason: New leader a86f653b06014ffd8a3ef211aa292eee. Latest consensus state: current_term: 1 leader_uuid: "a86f653b06014ffd8a3ef211aa292eee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a86f653b06014ffd8a3ef211aa292eee" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37873 } } }
I20260811 16:43:15.809963 11956 sys_catalog.cc:458] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [sys.catalog]: This master's current role is: LEADER
I20260811 16:43:15.809998 11953 sys_catalog.cc:455] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a86f653b06014ffd8a3ef211aa292eee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a86f653b06014ffd8a3ef211aa292eee" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37873 } } }
I20260811 16:43:15.810098 11953 sys_catalog.cc:458] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee [sys.catalog]: This master's current role is: LEADER
W20260811 16:43:15.810946 11980 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:43:15.810994 11980 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:43:15.811059 11967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:43:15.811247 11967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:43:15.812873 11967 catalog_manager.cc:1347] Generated new cluster ID: fcf5bf3bce3240fbb37012b428fac9b1
I20260811 16:43:15.812924 11967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:43:15.819985 11967 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:43:15.820158 11967 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:43:15.825736 11967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a86f653b06014ffd8a3ef211aa292eee: Generated new TSK 0
I20260811 16:43:15.825953 11967 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:43:15.829701 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37873
--builtin_ntp_servers=127.27.186.84:38227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:43:15.915504 11986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:15.915735 11986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:15.915774 11986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:15.916929 11986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:15.916992 11986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:15.917035 11986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:43:15.918439 11986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:15.918737 11986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:15.919039 11986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:15.924182 12000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.924206 11995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:15.924216 11997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:15.924746 11986 server_base.cc:1034] running on GCE node
I20260811 16:43:15.924957 11986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:15.925228 11986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:15.926383 11986 hybrid_clock.cc:648] HybridClock initialized: now 1786466595926365 us; error 36 us; skew 500 ppm
I20260811 16:43:15.927754 11986 webserver.cc:460] Webserver started at http://127.27.186.65:42965/ using document root <none> and password file <none>
I20260811 16:43:15.928009 11986 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:15.928054 11986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:15.928200 11986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:15.929277 11986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "353d08915b704628975a780058793bfd"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "d74fe8397b5667b3c2f517ab0b394568"
server_key_iv: "88f6a19cb6395a383e918ef62afecca1"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.929683 11986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "353d08915b704628975a780058793bfd"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "d74fe8397b5667b3c2f517ab0b394568"
server_key_iv: "88f6a19cb6395a383e918ef62afecca1"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.931182 11986 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:43:15.931978 12010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.932150 11986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:43:15.932238 11986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "353d08915b704628975a780058793bfd"
format_stamp: "Formatted at 2026-08-11 16:43:15 on dist-test-slave-gsp7"
server_key: "d74fe8397b5667b3c2f517ab0b394568"
server_key_iv: "88f6a19cb6395a383e918ef62afecca1"
server_key_version: "encryptionkey@0"
I20260811 16:43:15.932305 11986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:15.935776 11986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:15.936045 11986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:15.936182 11986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:15.936432 11986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:15.936813 11986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:15.936851 11986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.936872 11986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:15.936914 11986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:15.943787 11986 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:37589
I20260811 16:43:15.943831 12204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:37589 every 8 connection(s)
I20260811 16:43:15.944193 11986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:43:15.945724 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 11986
I20260811 16:43:15.945820 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:43:15.946046 28393 external_mini_cluster.cc:1428] Setting key fd65c213517c4d99e8df3d8121136f42
I20260811 16:43:15.947081 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37873
--builtin_ntp_servers=127.27.186.84:38227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 16:43:15.947675 11950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.944991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:36315 (local address 127.27.186.126:37873)
0811 16:43:15.945064 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:15.945066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:15.945330 (+ 264us) server_negotiation.cc:407] Connection header received
0811 16:43:15.946012 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:15.946013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:15.946021 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:15.946079 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:15.947421 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:15.947422 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:15.947423 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:43:15.947427 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:15.947443 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:43:15.947447 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:15.947501 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:15.947587 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 16:43:15.947602 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 16:43:15.947877 12209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:15.945003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37873 (local address 127.27.186.65:36315)
0811 16:43:15.945208 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:15.945243 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:15.945886 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:15.946151 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:15.946155 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:15.946165 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:15.947234 (+ 1069us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:43:15.947235 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:15.947275 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:43:15.947313 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:15.947507 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:15.947512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:15.947516 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:43:15.947597 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:43:15.947662 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":98,"threads_started":1}
I20260811 16:43:15.949177 12205 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37873
I20260811 16:43:15.949286 12205 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:15.949462 12205 heartbeater.cc:511] Master 127.27.186.126:37873 requested a full tablet report, sending...
I20260811 16:43:15.950093 11884 ts_manager.cc:194] Registered new tserver with Master: 353d08915b704628975a780058793bfd (127.27.186.65:37589)
W20260811 16:43:16.031270 12215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:16.031481 12215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:16.031503 12215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:16.032615 12215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:16.032655 12215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:16.032680 12215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:43:16.034153 12215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:16.034415 12215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:16.034792 12215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:16.040086 12225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:16.040236 12215 server_base.cc:1034] running on GCE node
W20260811 16:43:16.040097 12227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:16.040140 12224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:16.040647 12215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:16.040916 12215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:16.042088 12215 hybrid_clock.cc:648] HybridClock initialized: now 1786466596042065 us; error 39 us; skew 500 ppm
I20260811 16:43:16.043356 12215 webserver.cc:460] Webserver started at http://127.27.186.66:38065/ using document root <none> and password file <none>
I20260811 16:43:16.043602 12215 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:16.043673 12215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:16.043839 12215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:16.044948 12215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "e298a105462541a687e28abcdb5c9c5c"
format_stamp: "Formatted at 2026-08-11 16:43:16 on dist-test-slave-gsp7"
server_key: "df593b0a05a1abe0182bc6437932bf35"
server_key_iv: "ad9aeda38b1d80747ce0d5b437907100"
server_key_version: "encryptionkey@0"
I20260811 16:43:16.045341 12215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "e298a105462541a687e28abcdb5c9c5c"
format_stamp: "Formatted at 2026-08-11 16:43:16 on dist-test-slave-gsp7"
server_key: "df593b0a05a1abe0182bc6437932bf35"
server_key_iv: "ad9aeda38b1d80747ce0d5b437907100"
server_key_version: "encryptionkey@0"
I20260811 16:43:16.046792 12215 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:43:16.047588 12242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:16.047823 12215 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:43:16.047935 12215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "e298a105462541a687e28abcdb5c9c5c"
format_stamp: "Formatted at 2026-08-11 16:43:16 on dist-test-slave-gsp7"
server_key: "df593b0a05a1abe0182bc6437932bf35"
server_key_iv: "ad9aeda38b1d80747ce0d5b437907100"
server_key_version: "encryptionkey@0"
I20260811 16:43:16.048024 12215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:16.051580 12215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:16.051862 12215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:16.052007 12215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:16.052228 12215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:16.052551 12215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:16.052606 12215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:16.052645 12215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:16.052672 12215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:16.059329 12215 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:37473
I20260811 16:43:16.059422 12434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:37473 every 8 connection(s)
I20260811 16:43:16.059768 12215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:43:16.062882 11950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:16.060529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:56517 (local address 127.27.186.126:37873)
0811 16:43:16.060600 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:16.060602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:16.060862 (+ 260us) server_negotiation.cc:407] Connection header received
0811 16:43:16.061352 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:16.061353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:16.061358 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:16.061418 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:16.062663 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:16.062665 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:16.062665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:43:16.062670 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:16.062687 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:43:16.062693 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:16.062748 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:16.062812 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 16:43:16.062825 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:43:16.063058 12438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:16.060514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37873 (local address 127.27.186.66:56517)
0811 16:43:16.060723 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:16.060767 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:16.061263 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:16.061551 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:16.061555 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:16.061565 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:16.062513 (+ 948us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:43:16.062513 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:16.062542 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:43:16.062571 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:16.062748 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:16.062751 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:16.062753 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:43:16.062805 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:43:16.062852 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":104,"threads_started":1}
I20260811 16:43:16.063383 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 12215
I20260811 16:43:16.063510 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:43:16.063611 12435 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37873
I20260811 16:43:16.063695 28393 external_mini_cluster.cc:1428] Setting key f57311202f8b81ca3201ec695318951f
I20260811 16:43:16.063728 12435 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:16.063889 12435 heartbeater.cc:511] Master 127.27.186.126:37873 requested a full tablet report, sending...
I20260811 16:43:16.064352 11883 ts_manager.cc:194] Registered new tserver with Master: e298a105462541a687e28abcdb5c9c5c (127.27.186.66:37473)
I20260811 16:43:16.064775 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37873
--builtin_ntp_servers=127.27.186.84:38227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 16:43:16.149452 12441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:16.149762 12441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:16.149845 12441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:16.151091 12441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:16.151153 12441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:16.151199 12441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:43:16.152633 12441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:37873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:16.152894 12441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:16.153213 12441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:16.158399 12451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:16.158525 12455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:16.158399 12452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:16.158717 12441 server_base.cc:1034] running on GCE node
I20260811 16:43:16.159015 12441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:16.159276 12441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:16.160423 12441 hybrid_clock.cc:648] HybridClock initialized: now 1786466596160409 us; error 29 us; skew 500 ppm
I20260811 16:43:16.161813 12441 webserver.cc:460] Webserver started at http://127.27.186.67:40651/ using document root <none> and password file <none>
I20260811 16:43:16.162086 12441 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:16.162133 12441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:16.162303 12441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:16.163429 12441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "31b7e67411be49bf832f655df8d95e1c"
format_stamp: "Formatted at 2026-08-11 16:43:16 on dist-test-slave-gsp7"
server_key: "72467ecbebca89506456f8a63c37017d"
server_key_iv: "517167174d40e5a611a3f028ff942d42"
server_key_version: "encryptionkey@0"
I20260811 16:43:16.163808 12441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "31b7e67411be49bf832f655df8d95e1c"
format_stamp: "Formatted at 2026-08-11 16:43:16 on dist-test-slave-gsp7"
server_key: "72467ecbebca89506456f8a63c37017d"
server_key_iv: "517167174d40e5a611a3f028ff942d42"
server_key_version: "encryptionkey@0"
I20260811 16:43:16.165166 12441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:43:16.165997 12462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:16.166190 12441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:43:16.166285 12441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "31b7e67411be49bf832f655df8d95e1c"
format_stamp: "Formatted at 2026-08-11 16:43:16 on dist-test-slave-gsp7"
server_key: "72467ecbebca89506456f8a63c37017d"
server_key_iv: "517167174d40e5a611a3f028ff942d42"
server_key_version: "encryptionkey@0"
I20260811 16:43:16.166360 12441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:16.169757 12441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:16.170048 12441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:16.170202 12441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:16.170428 12441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:16.170753 12441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:16.170809 12441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:16.170848 12441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:16.170876 12441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:16.177304 12441 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:40765
I20260811 16:43:16.177412 12649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:40765 every 8 connection(s)
I20260811 16:43:16.177820 12441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:43:16.180114 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 12441
I20260811 16:43:16.180212 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:43:16.180441 28393 external_mini_cluster.cc:1428] Setting key 586c54e1c1e0a37a4e7cd28c161d2b57
I20260811 16:43:16.181726 11950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:16.179100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:59753 (local address 127.27.186.126:37873)
0811 16:43:16.179154 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:16.179157 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:16.179324 (+ 167us) server_negotiation.cc:407] Connection header received
0811 16:43:16.179958 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:16.179959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:16.179967 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:16.180028 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:16.181460 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:16.181461 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:16.181462 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:43:16.181467 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:16.181503 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:43:16.181507 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:16.181561 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:16.181640 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 16:43:16.181656 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:43:16.181921 12653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:16.178765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:37873 (local address 127.27.186.67:59753)
0811 16:43:16.179100 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:16.179181 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:16.179817 (+ 636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:16.180118 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:16.180124 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:16.180134 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:16.181288 (+ 1154us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:43:16.181289 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:16.181318 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:43:16.181349 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:16.181559 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:16.181565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:16.181569 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:43:16.181640 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:43:16.181705 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":83,"threads_started":1}
I20260811 16:43:16.182358 12650 heartbeater.cc:347] Connected to a master server at 127.27.186.126:37873
I20260811 16:43:16.182474 12650 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:16.182636 12650 heartbeater.cc:511] Master 127.27.186.126:37873 requested a full tablet report, sending...
I20260811 16:43:16.182977 11883 ts_manager.cc:194] Registered new tserver with Master: 31b7e67411be49bf832f655df8d95e1c (127.27.186.67:40765)
I20260811 16:43:16.192224 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 16:43:16.194315 11950 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:43:16.193755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53726 (local address 127.27.186.126:37873)
0811 16:43:16.193835 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:16.193838 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:16.193944 (+ 106us) server_negotiation.cc:407] Connection header received
0811 16:43:16.193988 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:16.193989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:16.193994 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:16.194075 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:16.194240 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53726: BlockingRecv error: recv got EOF from 127.0.0.1:53726 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:43:16.194402 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 11986
I20260811 16:43:16.220472 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 12215
I20260811 16:43:16.230680 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 12441
I20260811 16:43:16.246392 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 11820
2026-08-11T16:43:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (596 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:43:16 dist-test-slave-gsp7 krb5kdc[12665](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:43:16 dist-test-slave-gsp7 krb5kdc[12665](info): set up 2 sockets
Aug 11 16:43:16 dist-test-slave-gsp7 krb5kdc[12665](info): commencing operation
krb5kdc: starting...
W20260811 16:43:17.546913 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:43:17 dist-test-slave-gsp7 krb5kdc[12665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:43:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:43:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:43:17.677531 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34051
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:34051
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:43:17.759891 12688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:17.760092 12688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:17.760114 12688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:17.761531 12688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:43:17.761584 12688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:17.761600 12688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:17.761612 12688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:43:17.761624 12688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:43:17.763202 12688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:34051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:17.763398 12688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:17.763585 12688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:17.768555 12702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:17.768529 12700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:17.768530 12705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:17.768725 12688 server_base.cc:1034] running on GCE node
I20260811 16:43:17.769125 12688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:17.769373 12688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:17.770522 12688 hybrid_clock.cc:648] HybridClock initialized: now 1786466597770499 us; error 37 us; skew 500 ppm
Aug 11 16:43:17 dist-test-slave-gsp7 krb5kdc[12665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466597, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:43:17.773273 12688 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:43:17.773800 12688 webserver.cc:460] Webserver started at http://127.27.186.126:38203/ using document root <none> and password file <none>
I20260811 16:43:17.774061 12688 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:17.774108 12688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:17.774283 12688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:17.775364 12688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "3c3d73f1eadf4482860de9c1c219b85f"
format_stamp: "Formatted at 2026-08-11 16:43:17 on dist-test-slave-gsp7"
server_key: "429482fcca2ce8975b1575c894863289"
server_key_iv: "0e7db6281053d4f628c5f10b0da3fda5"
server_key_version: "encryptionkey@0"
I20260811 16:43:17.775729 12688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "3c3d73f1eadf4482860de9c1c219b85f"
format_stamp: "Formatted at 2026-08-11 16:43:17 on dist-test-slave-gsp7"
server_key: "429482fcca2ce8975b1575c894863289"
server_key_iv: "0e7db6281053d4f628c5f10b0da3fda5"
server_key_version: "encryptionkey@0"
I20260811 16:43:17.777101 12688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:43:17.777930 12716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:17.778126 12688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:43:17.778227 12688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "3c3d73f1eadf4482860de9c1c219b85f"
format_stamp: "Formatted at 2026-08-11 16:43:17 on dist-test-slave-gsp7"
server_key: "429482fcca2ce8975b1575c894863289"
server_key_iv: "0e7db6281053d4f628c5f10b0da3fda5"
server_key_version: "encryptionkey@0"
I20260811 16:43:17.778301 12688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:17.794996 12688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:17.797631 12688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:17.797806 12688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:17.802044 12688 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:34051
I20260811 16:43:17.802114 12798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:34051 every 8 connection(s)
I20260811 16:43:17.802482 12688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:43:17.803169 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 12688
I20260811 16:43:17.803253 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:43:17.803465 28393 external_mini_cluster.cc:1428] Setting key 68bea8d6e006c2bd713f5fe2beac18a3
I20260811 16:43:17.803614 12799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:43:17.807092 12799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f: Bootstrap starting.
I20260811 16:43:17.807816 12799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f: Neither blocks nor log segments found. Creating new log.
I20260811 16:43:17.808154 12799 log.cc:824] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:43:17.808868 12799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f: No bootstrap required, opened a new log
Aug 11 16:43:17 dist-test-slave-gsp7 krb5kdc[12665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:43:17.811339 12799 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c3d73f1eadf4482860de9c1c219b85f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34051 } }
I20260811 16:43:17.811506 12799 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:43:17.811545 12799 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c3d73f1eadf4482860de9c1c219b85f, State: Initialized, Role: FOLLOWER
I20260811 16:43:17.811684 12799 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c3d73f1eadf4482860de9c1c219b85f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34051 } }
I20260811 16:43:17.811780 12799 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:43:17.811820 12799 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:43:17.811868 12799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:43:17.812395 12799 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c3d73f1eadf4482860de9c1c219b85f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34051 } }
I20260811 16:43:17.812526 12799 leader_election.cc:302] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c3d73f1eadf4482860de9c1c219b85f; no voters:
I20260811 16:43:17.812727 12799 leader_election.cc:288] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:43:17.812760 12806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:43:17.812867 12806 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [term 1 LEADER]: Becoming Leader. State: Replica: 3c3d73f1eadf4482860de9c1c219b85f, State: Running, Role: LEADER
I20260811 16:43:17.812949 12806 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c3d73f1eadf4482860de9c1c219b85f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34051 } }
I20260811 16:43:17.813015 12799 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:43:17.813275 12806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c3d73f1eadf4482860de9c1c219b85f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c3d73f1eadf4482860de9c1c219b85f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34051 } } }
I20260811 16:43:17.813349 12806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [sys.catalog]: This master's current role is: LEADER
I20260811 16:43:17.813512 12806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c3d73f1eadf4482860de9c1c219b85f. Latest consensus state: current_term: 1 leader_uuid: "3c3d73f1eadf4482860de9c1c219b85f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c3d73f1eadf4482860de9c1c219b85f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34051 } } }
I20260811 16:43:17.813602 12806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f [sys.catalog]: This master's current role is: LEADER
W20260811 16:43:17.814978 12834 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:43:17.815083 12834 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:43:17.815193 12816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:43:17.815431 12816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:43:17.815692 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:17.804070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50390 (local address 127.27.186.126:34051)
0811 16:43:17.804246 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:17.804258 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:17.804288 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:43:17.804832 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:17.804839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:17.804887 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:17.805012 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:17.805911 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:17.806804 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:17.807851 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:17.808346 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:17.808510 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:17.811265 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:17.811269 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:17.811270 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:43:17.811289 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:17.813541 (+ 2252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:17.813991 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:17.813993 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:17.813994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:17.814098 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:17.814360 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:17.814361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:17.814362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:17.814691 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:17.815241 (+ 550us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:17.815332 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 16:43:17.815483 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260811 16:43:17.817375 12816 catalog_manager.cc:1347] Generated new cluster ID: bcc87e7e86924bebbcb2a8a8e0264492
I20260811 16:43:17.817447 12816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:43:17.838862 12816 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:43:17.839505 12816 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:43:17.841640 12816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f: Generated new TSK 0
I20260811 16:43:17.841862 12816 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:43:17.872609 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34051
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:43:17.956405 12843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:17.956617 12843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:17.956640 12843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:17.957849 12843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:17.957895 12843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:17.957922 12843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:43:17.959365 12843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:17.959559 12843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:17.959753 12843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:17.964859 12856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:17.964884 12863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:17.964850 12859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:17.965160 12843 server_base.cc:1034] running on GCE node
I20260811 16:43:17.965343 12843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:17.965601 12843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:17.966774 12843 hybrid_clock.cc:648] HybridClock initialized: now 1786466597966763 us; error 30 us; skew 500 ppm
Aug 11 16:43:17 dist-test-slave-gsp7 krb5kdc[12665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466597, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:43:17.970397 12843 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:43:17.970916 12843 webserver.cc:460] Webserver started at http://127.27.186.65:39341/ using document root <none> and password file <none>
I20260811 16:43:17.971136 12843 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:17.971182 12843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:17.971290 12843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:17.972373 12843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7"
format_stamp: "Formatted at 2026-08-11 16:43:17 on dist-test-slave-gsp7"
server_key: "546d49b2b93e391217006816d1e88049"
server_key_iv: "7636d91ed2796de0dc236163c88a18f6"
server_key_version: "encryptionkey@0"
I20260811 16:43:17.972709 12843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7"
format_stamp: "Formatted at 2026-08-11 16:43:17 on dist-test-slave-gsp7"
server_key: "546d49b2b93e391217006816d1e88049"
server_key_iv: "7636d91ed2796de0dc236163c88a18f6"
server_key_version: "encryptionkey@0"
I20260811 16:43:17.974292 12843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:43:17.975082 12872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:17.975293 12843 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:43:17.975361 12843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7"
format_stamp: "Formatted at 2026-08-11 16:43:17 on dist-test-slave-gsp7"
server_key: "546d49b2b93e391217006816d1e88049"
server_key_iv: "7636d91ed2796de0dc236163c88a18f6"
server_key_version: "encryptionkey@0"
I20260811 16:43:17.975418 12843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:17.983268 12843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:17.985116 12843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:17.985230 12843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:17.985417 12843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:17.985770 12843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:17.985805 12843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:17.985827 12843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:17.985839 12843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:17.992151 12843 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:36369
I20260811 16:43:17.992195 13072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:36369 every 8 connection(s)
I20260811 16:43:17.992527 12843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:43:17.998306 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 12843
I20260811 16:43:17.998449 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:43:17.998651 28393 external_mini_cluster.cc:1428] Setting key 7e476398931413383d2a423cfbc2aa63
Aug 11 16:43:17 dist-test-slave-gsp7 krb5kdc[12665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466597, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:43:18.002826 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:17.993260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:39433 (local address 127.27.186.126:34051)
0811 16:43:17.993322 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:17.993324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:17.993655 (+ 331us) server_negotiation.cc:407] Connection header received
0811 16:43:17.994153 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:17.994154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:17.994165 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:17.994219 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:17.995191 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:17.995706 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:17.996673 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:17.996881 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:17.996956 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:17.999447 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:17.999448 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:17.999449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:43:17.999457 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:18.001171 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:18.001749 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:18.001750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:18.001751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:18.001821 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:18.002108 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:18.002109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:18.002110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:18.002236 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:18.002313 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.002627 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.002731 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:43:18.003026 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:17.993258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34051 (local address 127.27.186.65:39433)
0811 16:43:17.993468 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:17.993554 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:17.994067 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:17.994294 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:17.994297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:17.994882 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:17.995092 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:17.995097 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:17.995797 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:17.995798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:17.996591 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:17.996593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:17.996984 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:17.996985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:17.997085 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:17.997657 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:17.997665 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:17.999334 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:18.001263 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:43:18.001270 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:43:18.001273 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:43:18.001648 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:43:18.001901 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:43:18.001902 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:43:18.001902 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:43:18.002030 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:43:18.002316 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:18.002325 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:18.002482 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 16:43:18.002589 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 16:43:18.002767 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":123,"threads_started":1}
I20260811 16:43:18.003629 13074 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34051
I20260811 16:43:18.003731 13074 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:18.003953 13074 heartbeater.cc:511] Master 127.27.186.126:34051 requested a full tablet report, sending...
I20260811 16:43:18.004593 12739 ts_manager.cc:194] Registered new tserver with Master: fbe190c4f7944d5aa49c87fd7c6ee6a7 (127.27.186.65:36369)
I20260811 16:43:18.005435 12739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:39433
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:43:18.029261 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34051
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:43:18.113484 13090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:18.113770 13090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:18.113814 13090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:18.115058 13090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:18.115101 13090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:18.115129 13090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:43:18.116565 13090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:18.116756 13090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:18.116937 13090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:18.121948 13103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:18.122022 13110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:18.122179 13100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:18.122493 13090 server_base.cc:1034] running on GCE node
I20260811 16:43:18.122669 13090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:18.122895 13090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:18.124042 13090 hybrid_clock.cc:648] HybridClock initialized: now 1786466598124019 us; error 37 us; skew 500 ppm
Aug 11 16:43:18 dist-test-slave-gsp7 krb5kdc[12665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466598, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:43:18.126650 13090 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:43:18.127126 13090 webserver.cc:460] Webserver started at http://127.27.186.66:35341/ using document root <none> and password file <none>
I20260811 16:43:18.127363 13090 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:18.127435 13090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:18.127592 13090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:18.128681 13090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "e7fc3c8ccc93408cabb2ac8eabc06812"
format_stamp: "Formatted at 2026-08-11 16:43:18 on dist-test-slave-gsp7"
server_key: "b8d76e06085a0261c08f1730b58f21cd"
server_key_iv: "01aa311c58840be86b03d183c92f364f"
server_key_version: "encryptionkey@0"
I20260811 16:43:18.129069 13090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "e7fc3c8ccc93408cabb2ac8eabc06812"
format_stamp: "Formatted at 2026-08-11 16:43:18 on dist-test-slave-gsp7"
server_key: "b8d76e06085a0261c08f1730b58f21cd"
server_key_iv: "01aa311c58840be86b03d183c92f364f"
server_key_version: "encryptionkey@0"
I20260811 16:43:18.130580 13090 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:43:18.131372 13123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:18.131544 13090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:43:18.131659 13090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "e7fc3c8ccc93408cabb2ac8eabc06812"
format_stamp: "Formatted at 2026-08-11 16:43:18 on dist-test-slave-gsp7"
server_key: "b8d76e06085a0261c08f1730b58f21cd"
server_key_iv: "01aa311c58840be86b03d183c92f364f"
server_key_version: "encryptionkey@0"
I20260811 16:43:18.131737 13090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:18.149230 13090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:18.151365 13090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:18.151578 13090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:18.151835 13090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:18.152175 13090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:18.152232 13090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:18.152274 13090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:18.152304 13090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:18.158631 13090 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:41231
I20260811 16:43:18.158684 13324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:41231 every 8 connection(s)
I20260811 16:43:18.159013 13090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:43:18 dist-test-slave-gsp7 krb5kdc[12665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466598, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:43:18.165513 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 13090
I20260811 16:43:18.165625 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:43:18.165853 28393 external_mini_cluster.cc:1428] Setting key 92fd442c2270284beaa53d1a9fa50be7
I20260811 16:43:18.168934 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.159689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:60923 (local address 127.27.186.126:34051)
0811 16:43:18.159777 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.159779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.159993 (+ 214us) server_negotiation.cc:407] Connection header received
0811 16:43:18.160488 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.160489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.160500 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.160557 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:18.161699 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.162201 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.163180 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.163366 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.163432 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.165758 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:18.165759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:18.165759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:43:18.165765 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:18.167337 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:18.167858 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:18.167859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:18.167860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:18.167913 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:18.168199 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:18.168200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:18.168200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:18.168297 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:18.168348 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.168687 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.168801 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 16:43:18.169044 13330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.159645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34051 (local address 127.27.186.66:60923)
0811 16:43:18.159862 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:18.159910 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:18.160394 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:18.160620 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:18.160623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:18.161309 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:18.161613 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.161619 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.162290 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.162291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.163101 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.163103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.163445 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.163446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.163555 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.164081 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:18.164089 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:18.165668 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:18.167433 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:43:18.167441 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:43:18.167444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:43:18.167780 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:43:18.167985 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:43:18.167985 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:43:18.167986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:43:18.168131 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:43:18.168363 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:18.168369 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:18.168533 (+ 164us) client_negotiation.cc:769] Sending connection context
0811 16:43:18.168650 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 16:43:18.168836 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":101,"threads_started":1}
I20260811 16:43:18.169571 13327 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34051
I20260811 16:43:18.169694 13327 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:18.169881 13327 heartbeater.cc:511] Master 127.27.186.126:34051 requested a full tablet report, sending...
I20260811 16:43:18.170331 12739 ts_manager.cc:194] Registered new tserver with Master: e7fc3c8ccc93408cabb2ac8eabc06812 (127.27.186.66:41231)
I20260811 16:43:18.170702 12739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:60923
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:43:18.196727 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34051
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:43:18.281291 13334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:43:18.281522 13334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:43:18.281591 13334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:43:18.282812 13334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:43:18.282856 13334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:43:18.282883 13334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:43:18.284344 13334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:43:18.284593 13334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:43:18.284832 13334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:43:18.289891 13348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:18.290023 13334 server_base.cc:1034] running on GCE node
W20260811 16:43:18.289880 13343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:43:18.289880 13350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:43:18.290356 13334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:43:18.290632 13334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:43:18.291780 13334 hybrid_clock.cc:648] HybridClock initialized: now 1786466598291762 us; error 38 us; skew 500 ppm
Aug 11 16:43:18 dist-test-slave-gsp7 krb5kdc[12665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466598, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:43:18.294600 13334 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:43:18.295001 13334 webserver.cc:460] Webserver started at http://127.27.186.67:32907/ using document root <none> and password file <none>
I20260811 16:43:18.295212 13334 fs_manager.cc:359] Metadata directory not provided
I20260811 16:43:18.295254 13334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:43:18.295346 13334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:43:18.296403 13334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "b253cf1ca2bb40479a2b85418bf89fc8"
format_stamp: "Formatted at 2026-08-11 16:43:18 on dist-test-slave-gsp7"
server_key: "6c9560c77e14dcd57808130e139fb581"
server_key_iv: "45443ba272d1a2dc923ceeae7ce4e93f"
server_key_version: "encryptionkey@0"
I20260811 16:43:18.296731 13334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "b253cf1ca2bb40479a2b85418bf89fc8"
format_stamp: "Formatted at 2026-08-11 16:43:18 on dist-test-slave-gsp7"
server_key: "6c9560c77e14dcd57808130e139fb581"
server_key_iv: "45443ba272d1a2dc923ceeae7ce4e93f"
server_key_version: "encryptionkey@0"
I20260811 16:43:18.298177 13334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:43:18.298966 13367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:18.299178 13334 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:43:18.299245 13334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "b253cf1ca2bb40479a2b85418bf89fc8"
format_stamp: "Formatted at 2026-08-11 16:43:18 on dist-test-slave-gsp7"
server_key: "6c9560c77e14dcd57808130e139fb581"
server_key_iv: "45443ba272d1a2dc923ceeae7ce4e93f"
server_key_version: "encryptionkey@0"
I20260811 16:43:18.299301 13334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:43:18.311065 13334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:43:18.313159 13334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:43:18.313339 13334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:43:18.313614 13334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:43:18.313905 13334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:43:18.313936 13334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:18.313961 13334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:43:18.313975 13334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:43:18.320230 13334 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:35145
I20260811 16:43:18.320359 13564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:35145 every 8 connection(s)
I20260811 16:43:18.320655 13334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:43:18.322502 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 13334
I20260811 16:43:18.322614 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:43:18.322839 28393 external_mini_cluster.cc:1428] Setting key 46bf4aed543ef6ff5222392439b59fab
Aug 11 16:43:18 dist-test-slave-gsp7 krb5kdc[12665](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466598, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:43:18.330399 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.321417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:38623 (local address 127.27.186.126:34051)
0811 16:43:18.321461 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.321464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.321680 (+ 216us) server_negotiation.cc:407] Connection header received
0811 16:43:18.322187 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.322188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.322199 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.322261 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:18.323662 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.324228 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.325251 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.325455 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.325591 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.327807 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:18.327809 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:18.327809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:43:18.327817 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:18.329088 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:18.329517 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:18.329519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:18.329519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:18.329580 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:18.329811 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:18.329812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:18.329812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:18.329951 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:18.330005 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.330267 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.330331 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:43:18.330621 13568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.321368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34051 (local address 127.27.186.67:38623)
0811 16:43:18.321548 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:18.321593 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:18.322103 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:18.322374 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:18.322379 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:18.323263 (+ 884us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:43:18.323569 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.323576 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.324313 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.324314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.325143 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.325146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.325607 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.325608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.325715 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.326289 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:43:18.326298 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:43:18.327721 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:43:18.329166 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:43:18.329173 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:43:18.329174 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:43:18.329407 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:43:18.329646 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:43:18.329647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:43:18.329647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:43:18.329751 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:43:18.330025 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:43:18.330032 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:43:18.330151 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 16:43:18.330239 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:43:18.330386 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":96,"threads_started":1}
I20260811 16:43:18.331125 13565 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34051
I20260811 16:43:18.331243 13565 heartbeater.cc:464] Registering TS with master...
I20260811 16:43:18.331429 13565 heartbeater.cc:511] Master 127.27.186.126:34051 requested a full tablet report, sending...
I20260811 16:43:18.331831 12739 ts_manager.cc:194] Registered new tserver with Master: b253cf1ca2bb40479a2b85418bf89fc8 (127.27.186.67:35145)
I20260811 16:43:18.332178 12739 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:38623
I20260811 16:43:18.334697 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:43:18.341991 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.336266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50404 (local address 127.27.186.126:34051)
0811 16:43:18.336308 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.336309 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.336400 (+ 91us) server_negotiation.cc:407] Connection header received
0811 16:43:18.336445 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.336446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.336455 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.336512 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:43:18.337047 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.337584 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.338320 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.338510 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.338578 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.339763 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:43:18.339764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:43:18.339764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:43:18.339771 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:43:18.340916 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:18.341220 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:18.341221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:18.341221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:18.341267 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:43:18.341469 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:43:18.341470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:43:18.341470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:43:18.341698 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:43:18.341779 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.341862 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.341919 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:43:18.343473 12739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50404:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:43:18.345009 12739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:43:18.351671 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.347338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:36369 (local address 127.0.0.1:56072)
0811 16:43:18.347507 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:18.347552 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:18.347621 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:18.348033 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:18.348035 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:18.348037 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:43:18.348102 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.348104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.349100 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.349101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.350391 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.350394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.351311 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.351312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.351402 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.351416 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:43:18.351519 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:43:18.351583 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":4,"thread_start_us":66,"threads_started":1}
I20260811 16:43:18.351675 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.347462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56072 (local address 127.27.186.65:36369)
0811 16:43:18.347855 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.347865 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.347885 (+ 20us) server_negotiation.cc:407] Connection header received
0811 16:43:18.347920 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.347921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.347934 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.348035 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:43:18.348189 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.349004 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.350483 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.351209 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.351307 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.351368 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.351540 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.351583 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":95,"threads_started":1}
I20260811 16:43:18.352095 13590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.347389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:35145 (local address 127.0.0.1:41156)
0811 16:43:18.347785 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:18.347794 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:18.347831 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:18.348638 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:18.348639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:18.348641 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:43:18.348699 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.348700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.349834 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.349835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.350937 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.350940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.351842 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.351843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.351929 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.351933 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:43:18.351988 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:43:18.352028 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":72,"threads_started":1}
I20260811 16:43:18.352138 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.347609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41156 (local address 127.27.186.67:35145)
0811 16:43:18.348469 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.348474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.348484 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:43:18.348521 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.348523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.348538 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.348620 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:43:18.348774 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.349735 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.351031 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.351752 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.351827 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.351896 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.352013 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.352056 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":819,"thread_start_us":110,"threads_started":1}
I20260811 16:43:18.352118 13596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.347611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49898 (local address 127.27.186.66:41231)
0811 16:43:18.347811 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.347815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.347826 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:43:18.347882 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.347884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.347900 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.348003 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:43:18.348212 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.349346 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.350650 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.351237 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.351309 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.351375 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.351630 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.351674 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":105,"threads_started":1}
I20260811 16:43:18.352579 13588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.347365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:41231 (local address 127.0.0.1:49898)
0811 16:43:18.347657 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:18.347667 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:18.347710 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:18.348012 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:18.348017 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:18.348019 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:43:18.348121 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.348123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.349467 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.349468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.350565 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.350568 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.351411 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.351412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.351486 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.351490 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:43:18.351538 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 16:43:18.351587 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":6,"thread_start_us":93,"threads_started":1}
I20260811 16:43:18.352520 12962 tablet_service.cc:1467] Processing CreateTablet for tablet e2d3a6bd9af149d2b3fd9e6af62cce93 (DEFAULT_TABLE table=test-table [id=4b95192e2f574ac7b76166ac53220a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:43:18.352777 13459 tablet_service.cc:1467] Processing CreateTablet for tablet e2d3a6bd9af149d2b3fd9e6af62cce93 (DEFAULT_TABLE table=test-table [id=4b95192e2f574ac7b76166ac53220a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:43:18.352907 12962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d3a6bd9af149d2b3fd9e6af62cce93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:43:18.353092 13459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d3a6bd9af149d2b3fd9e6af62cce93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:43:18.353205 13208 tablet_service.cc:1467] Processing CreateTablet for tablet e2d3a6bd9af149d2b3fd9e6af62cce93 (DEFAULT_TABLE table=test-table [id=4b95192e2f574ac7b76166ac53220a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:43:18.353451 13208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2d3a6bd9af149d2b3fd9e6af62cce93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:43:18.356050 13599 tablet_bootstrap.cc:492] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Bootstrap starting.
I20260811 16:43:18.356526 13600 tablet_bootstrap.cc:492] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7: Bootstrap starting.
I20260811 16:43:18.356928 13599 tablet_bootstrap.cc:654] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Neither blocks nor log segments found. Creating new log.
I20260811 16:43:18.357232 13600 tablet_bootstrap.cc:654] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7: Neither blocks nor log segments found. Creating new log.
I20260811 16:43:18.357561 13599 log.cc:824] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Log is configured to *not* fsync() on all Append() calls
I20260811 16:43:18.357682 13602 tablet_bootstrap.cc:492] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: Bootstrap starting.
I20260811 16:43:18.357880 13600 log.cc:824] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:43:18.358372 13599 tablet_bootstrap.cc:492] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: No bootstrap required, opened a new log
I20260811 16:43:18.358388 13602 tablet_bootstrap.cc:654] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: Neither blocks nor log segments found. Creating new log.
I20260811 16:43:18.358471 13599 ts_tablet_manager.cc:1397] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 16:43:18.358724 13600 tablet_bootstrap.cc:492] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7: No bootstrap required, opened a new log
I20260811 16:43:18.358808 13600 ts_tablet_manager.cc:1397] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:43:18.358961 13602 log.cc:824] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: Log is configured to *not* fsync() on all Append() calls
I20260811 16:43:18.359732 13602 tablet_bootstrap.cc:492] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: No bootstrap required, opened a new log
I20260811 16:43:18.359809 13602 ts_tablet_manager.cc:1397] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:43:18.360587 13600 raft_consensus.cc:348] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.360566 13599 raft_consensus.cc:348] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.360745 13599 raft_consensus.cc:374] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:43:18.360746 13600 raft_consensus.cc:374] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:43:18.360790 13600 raft_consensus.cc:729] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbe190c4f7944d5aa49c87fd7c6ee6a7, State: Initialized, Role: FOLLOWER
I20260811 16:43:18.360790 13599 raft_consensus.cc:729] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7fc3c8ccc93408cabb2ac8eabc06812, State: Initialized, Role: FOLLOWER
I20260811 16:43:18.360914 13599 consensus_queue.cc:260] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.360921 13600 consensus_queue.cc:260] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.361214 13599 ts_tablet_manager.cc:1428] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:43:18.361250 13074 heartbeater.cc:503] Master 127.27.186.126:34051 was elected leader, sending a full tablet report...
I20260811 16:43:18.361367 13327 heartbeater.cc:503] Master 127.27.186.126:34051 was elected leader, sending a full tablet report...
I20260811 16:43:18.361233 13600 ts_tablet_manager.cc:1428] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260811 16:43:18.361956 13602 raft_consensus.cc:348] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.362115 13602 raft_consensus.cc:374] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:43:18.362164 13602 raft_consensus.cc:729] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b253cf1ca2bb40479a2b85418bf89fc8, State: Initialized, Role: FOLLOWER
I20260811 16:43:18.362277 13602 consensus_queue.cc:260] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.362533 13602 ts_tablet_manager.cc:1428] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:43:18.362617 13565 heartbeater.cc:503] Master 127.27.186.126:34051 was elected leader, sending a full tablet report...
W20260811 16:43:18.409585 13329 tablet.cc:2369] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:43:18.435117 13610 raft_consensus.cc:482] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:43:18.435261 13610 raft_consensus.cc:504] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.435719 13610 leader_election.cc:288] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b253cf1ca2bb40479a2b85418bf89fc8 (127.27.186.67:35145), e7fc3c8ccc93408cabb2ac8eabc06812 (127.27.186.66:41231)
I20260811 16:43:18.438771 13596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.435976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:42501 (local address 127.27.186.66:41231)
0811 16:43:18.436029 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.436032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.436116 (+ 84us) server_negotiation.cc:407] Connection header received
0811 16:43:18.436205 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.436207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.436222 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.436312 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:43:18.436508 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.436989 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.438029 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.438406 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.438498 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.438507 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.438657 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.438695 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:43:18.438771 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.435919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:41231 (local address 127.27.186.65:42501)
0811 16:43:18.436003 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:18.436032 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:18.436133 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:18.436353 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:18.436354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:18.436356 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:43:18.436431 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.436433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.437079 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.437080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.437936 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.437939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.438495 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.438496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.438578 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.438582 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:43:18.438648 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:43:18.438690 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 16:43:18.438918 13617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.435926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:35145 (local address 127.27.186.65:55673)
0811 16:43:18.436168 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:18.436179 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:43:18.436241 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:43:18.436447 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:43:18.436448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:43:18.436450 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:43:18.436528 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.436530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.437165 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.437166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.438009 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:43:18.438011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.438589 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.438590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:43:18.438667 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.438671 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:43:18.438740 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 16:43:18.438780 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":14,"thread_start_us":133,"threads_started":1}
I20260811 16:43:18.439177 13241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d3a6bd9af149d2b3fd9e6af62cce93" candidate_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" is_pre_election: true
I20260811 16:43:18.439325 13241 raft_consensus.cc:2454] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbe190c4f7944d5aa49c87fd7c6ee6a7 in term 0.
I20260811 16:43:18.439435 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.436032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:55673 (local address 127.27.186.67:35145)
0811 16:43:18.436074 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.436076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.436269 (+ 193us) server_negotiation.cc:407] Connection header received
0811 16:43:18.436354 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.436356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.436366 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.436444 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:43:18.436613 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.437079 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.438106 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.438499 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.438589 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.438598 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.438748 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.438789 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:43:18.439572 12873 leader_election.cc:302] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7fc3c8ccc93408cabb2ac8eabc06812, fbe190c4f7944d5aa49c87fd7c6ee6a7; no voters:
I20260811 16:43:18.439718 13610 raft_consensus.cc:2781] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:43:18.439785 13610 raft_consensus.cc:482] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:43:18.439814 13610 raft_consensus.cc:3037] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:43:18.439760 13489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d3a6bd9af149d2b3fd9e6af62cce93" candidate_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" is_pre_election: true
I20260811 16:43:18.439909 13489 raft_consensus.cc:2454] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbe190c4f7944d5aa49c87fd7c6ee6a7 in term 0.
I20260811 16:43:18.440650 13610 raft_consensus.cc:504] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.440806 13610 leader_election.cc:288] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [CANDIDATE]: Term 1 election: Requested vote from peers b253cf1ca2bb40479a2b85418bf89fc8 (127.27.186.67:35145), e7fc3c8ccc93408cabb2ac8eabc06812 (127.27.186.66:41231)
I20260811 16:43:18.441015 13241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d3a6bd9af149d2b3fd9e6af62cce93" candidate_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812"
I20260811 16:43:18.441040 13489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2d3a6bd9af149d2b3fd9e6af62cce93" candidate_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b253cf1ca2bb40479a2b85418bf89fc8"
I20260811 16:43:18.441098 13241 raft_consensus.cc:3037] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:43:18.441121 13489 raft_consensus.cc:3037] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:43:18.441888 13241 raft_consensus.cc:2454] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe190c4f7944d5aa49c87fd7c6ee6a7 in term 1.
I20260811 16:43:18.441988 13489 raft_consensus.cc:2454] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbe190c4f7944d5aa49c87fd7c6ee6a7 in term 1.
I20260811 16:43:18.442166 12873 leader_election.cc:302] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7fc3c8ccc93408cabb2ac8eabc06812, fbe190c4f7944d5aa49c87fd7c6ee6a7; no voters:
I20260811 16:43:18.442272 13610 raft_consensus.cc:2781] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:43:18.442459 13610 raft_consensus.cc:686] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [term 1 LEADER]: Becoming Leader. State: Replica: fbe190c4f7944d5aa49c87fd7c6ee6a7, State: Running, Role: LEADER
I20260811 16:43:18.442556 13610 consensus_queue.cc:237] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } }
I20260811 16:43:18.443444 12736 catalog_manager.cc:5495] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbe190c4f7944d5aa49c87fd7c6ee6a7 (127.27.186.65). New cstate: current_term: 1 leader_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbe190c4f7944d5aa49c87fd7c6ee6a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 36369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 } health_report { overall_health: UNKNOWN } } }
I20260811 16:43:18.471565 13593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.469098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56086 (local address 127.27.186.65:36369)
0811 16:43:18.469161 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:43:18.469163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:43:18.469171 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:43:18.469211 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:43:18.469212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:43:18.469231 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:43:18.469297 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:43:18.469446 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.469953 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.470781 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:43:18.470987 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:43:18.471043 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:43:18.471207 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:43:18.471310 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:43:18.471372 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:43:18.471458 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 16:43:18.471482 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:43:18.473659 13241 raft_consensus.cc:1261] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 1 FOLLOWER]: Refusing update from remote peer fbe190c4f7944d5aa49c87fd7c6ee6a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:43:18.473699 13489 raft_consensus.cc:1261] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 1 FOLLOWER]: Refusing update from remote peer fbe190c4f7944d5aa49c87fd7c6ee6a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:43:18.474089 13618 consensus_queue.cc:1035] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7fc3c8ccc93408cabb2ac8eabc06812" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 41231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:43:18.474237 13610 consensus_queue.cc:1035] T e2d3a6bd9af149d2b3fd9e6af62cce93 P fbe190c4f7944d5aa49c87fd7c6ee6a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b253cf1ca2bb40479a2b85418bf89fc8" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:43:18.476776 13628 mvcc.cc:205] Tried to move back new op lower bound from 7317367187344658432 to 7317367187221237760. Current Snapshot: MvccSnapshot[applied={T|T < 7317367187344658432}]
I20260811 16:43:18.477397 13631 mvcc.cc:205] Tried to move back new op lower bound from 7317367187344658432 to 7317367187221237760. Current Snapshot: MvccSnapshot[applied={T|T < 7317367187344658432}]
I20260811 16:43:18.479979 12737 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:43:18.480113 12737 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:43:18.481027 12737 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c3d73f1eadf4482860de9c1c219b85f: Sending DeleteTablet for 3 replicas of tablet e2d3a6bd9af149d2b3fd9e6af62cce93
I20260811 16:43:18.481442 13459 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d3a6bd9af149d2b3fd9e6af62cce93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:43:18 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:41156
I20260811 16:43:18.481513 13208 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d3a6bd9af149d2b3fd9e6af62cce93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:43:18 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:49898
I20260811 16:43:18.481544 12962 tablet_service.cc:1514] Processing DeleteTablet for tablet e2d3a6bd9af149d2b3fd9e6af62cce93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:43:18 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:56072
I20260811 16:43:18.481784 13645 tablet_replica.cc:330] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: stopping tablet replica
I20260811 16:43:18.481877 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 12843
I20260811 16:43:18.481896 13645 raft_consensus.cc:2229] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:43:18.484800 13644 tablet_replica.cc:330] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: stopping tablet replica
I20260811 16:43:18.485008 13644 raft_consensus.cc:2229] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:43:18.485189 13644 raft_consensus.cc:2258] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:43:18.488678 13644 ts_tablet_manager.cc:1905] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:43:18.489820 13645 raft_consensus.cc:2258] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:43:18.491053 13644 ts_tablet_manager.cc:1918] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:43:18.492183 13645 ts_tablet_manager.cc:1905] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:43:18.492426 13644 log.cc:1196] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/e2d3a6bd9af149d2b3fd9e6af62cce93
I20260811 16:43:18.492831 13644 ts_tablet_manager.cc:1939] T e2d3a6bd9af149d2b3fd9e6af62cce93 P b253cf1ca2bb40479a2b85418bf89fc8: Deleting consensus metadata
I20260811 16:43:18.493520 12719 catalog_manager.cc:4841] TS b253cf1ca2bb40479a2b85418bf89fc8 (127.27.186.67:35145): tablet e2d3a6bd9af149d2b3fd9e6af62cce93 (table test-table [id=4b95192e2f574ac7b76166ac53220a99]) successfully deleted
I20260811 16:43:18.494004 13645 ts_tablet_manager.cc:1918] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:43:18.494117 13645 log.cc:1196] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/e2d3a6bd9af149d2b3fd9e6af62cce93
I20260811 16:43:18.494418 13645 ts_tablet_manager.cc:1939] T e2d3a6bd9af149d2b3fd9e6af62cce93 P e7fc3c8ccc93408cabb2ac8eabc06812: Deleting consensus metadata
I20260811 16:43:18.494872 12717 catalog_manager.cc:4841] TS e7fc3c8ccc93408cabb2ac8eabc06812 (127.27.186.66:41231): tablet e2d3a6bd9af149d2b3fd9e6af62cce93 (table test-table [id=4b95192e2f574ac7b76166ac53220a99]) successfully deleted
W20260811 16:43:18.503417 12718 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:36369 (error 108)
I20260811 16:43:18.504040 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:43:18.503913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:36369 (local address 127.0.0.1:56098)
0811 16:43:18.503970 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:43:18.504007 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:36369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:43:18.504159 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 13090
W20260811 16:43:18.504200 12718 catalog_manager.cc:4584] TS fbe190c4f7944d5aa49c87fd7c6ee6a7 (127.27.186.65:36369): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e2d3a6bd9af149d2b3fd9e6af62cce93: Network error: Client connection negotiation failed: client connection to 127.27.186.65:36369: connect: Connection refused (error 111)
I20260811 16:43:18.520529 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 13334
I20260811 16:43:18.535795 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 12688
2026-08-11T16:43:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2291 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:43:18 dist-test-slave-gsp7 krb5kdc[13650](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:43:18 dist-test-slave-gsp7 krb5kdc[13650](info): set up 2 sockets
Aug 11 16:43:18 dist-test-slave-gsp7 krb5kdc[13650](info): commencing operation
krb5kdc: starting...
W20260811 16:43:19.832576 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:43:19 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:43:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:43:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.27.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.27.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/rangeradmin_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/rangeradmin_127.27.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.27.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.27.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/rangerlookup_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/rangerlookup_127.27.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.27.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/HTTP_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/HTTP_127.27.186.84@KRBTEST.COM.keytab.
I20260811 16:43:20.009600 28393 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJargcS/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/postgres -l logfile start
2026-08-11 16:43:22.684 UTC [13709] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 16:43:22.684 UTC [13709] LOG: listening on IPv4 address "127.27.186.84", port 38783
2026-08-11 16:43:22.689 UTC [13709] LOG: listening on Unix socket "/tmp/.s.PGSQL.38783"
2026-08-11 16:43:22.731 UTC [13712] LOG: database system was shut down at 2026-08-11 16:43:21 UTC
2026-08-11 16:43:22.738 UTC [13709] LOG: database system is ready to accept connections
I20260811 16:43:23.918732 28393 mini_postgres.cc:96] Postgres bound to 38783
2026-08-11 16:43:23.926 UTC [13723] FATAL: database "slave" does not exist
127.27.186.84:38783 - accepting connections
I20260811 16:43:23.927417 28393 mini_ranger.cc:161] Starting Ranger...
I20260811 16:43:23.943531 28393 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 16:43:24.451577 28393 mini_ranger.cc:87] Created ranger Postgres database
I20260811 16:43:24.451668 28393 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-admin
2026-08-11 16:43:24,791 [I] DB FLAVOR :POSTGRES
2026-08-11 16:43:24,791 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:43:24,792 [I] Checking connection..
2026-08-11 16:43:24,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 16:43:25,054 [I] Checking connection passed.
2026-08-11 16:43:25,054 [I] --------- Verifying version history table ---------
2026-08-11 16:43:25,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:43:25,332 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:43:25,333 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:43:25,605 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:43:25,605 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 16:43:25,605 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 16:43:25.880 UTC [13837] WARNING: there is no transaction in progress
2026-08-11 16:43:25,889 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 16:43:25,889 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:43:26,152 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 16:43:26,153 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:43:26,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 16:43:26,405 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 16:43:26,646 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gsp7.c.gcp-upstream.internal','N') ;"
2026-08-11 16:43:26,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:43:27,168 [I] Table x_portal_user does not exist in database ranger
2026-08-11 16:43:27,168 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:43:27,417 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 16:43:27,418 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:43:27,686 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:43:27,956 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 16:43:27,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 16:43:28.961 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:28.978 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:28.995 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.010 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.027 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.044 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.106 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.113 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.133 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.145 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.157 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.172 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.182 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.189 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.197 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29.204 UTC [14028] WARNING: there is no transaction in progress
2026-08-11 16:43:29,864 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 16:43:29,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 16:43:30,114 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 16:43:30,114 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:43:30,397 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 16:43:30,398 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:43:30,677 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 16:43:30,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:43:30,916 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:43:31,185 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gsp7.c.gcp-upstream.internal';"
2026-08-11 16:43:31,449 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 16:43:31,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 16:43:31,720 [I] DB_PATCHES have already been applied
I20260811 16:43:31.726751 28393 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJargcS/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 16:43:31.726821 28393 mini_ranger.cc:193] Using host: 127.27.186.84
I20260811 16:43:31.730751 28393 mini_ranger.cc:227] Ranger admin URL: http://127.27.186.84:40211
Aug 11, 2026 4:43:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:43:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:43:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 4:43:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 4:43:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 4:43:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 4:43:32 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 16:43:33.145769 28393 mini_ranger.cc:160] Time spent starting Ranger: real 9.218s user 0.001s sys 0.010s
Aug 11, 2026 4:43:54 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 4:43:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 4:43:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 4:43:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 4:43:55 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 16:43:55.905333 28393 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.27.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.27.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/rangerkms_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/rangerkms_127.27.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.186.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.27.186.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.186.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/HTTP_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.186.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/HTTP_127.27.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 16:43:55 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466635, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 16:43:55.997563 28393 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 16:43:56.008569 28393 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 16:43:56.908213 28393 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 16:43:56.908303 28393 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms
I20260811 16:43:56.908325 28393 mini_ranger_kms.cc:227] Using postgres at 127.27.186.84:38783
2026-08-11 16:43:57,483 [I] DB FLAVOR :POSTGRES
2026-08-11 16:43:57,483 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:43:57,483 [I] Checking connection
2026-08-11 16:43:57,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 16:43:57,755 [I] connection success
2026-08-11 16:43:57,755 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 16:43:57,756 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 16:43:57,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 16:43:58,005 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 16:43:58,006 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:43:58,006 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 16:43:58,006 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:38783/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 16:43:58,291 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 16:43:58.851636 28393 mini_ranger_kms.cc:310] Created kms service
I20260811 16:43:59.064098 28393 mini_ranger_kms.cc:326] Created kudu user
I20260811 16:43:59.113183 28393 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 16:43:59 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466635, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:43:59.513741 28393 mini_ranger_kms.cc:384] Added ranger policy
I20260811 16:43:59.513866 28393 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 16:43:59.513891 28393 mini_ranger_kms.cc:240] Using host: 127.27.186.84
I20260811 16:43:59.518656 28393 mini_ranger_kms.cc:276] Ranger KMS PID: 14342
I20260811 16:43:59.518847 28393 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.27.186.84:46607
Aug 11, 2026 4:44:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:44:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:44:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 4:44:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 4:44:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 4:44:01 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 16:44:02 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466642, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.186.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:02.414238 28393 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.417s user 0.014s sys 0.270s
I20260811 16:44:02.414374 28393 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 16:44:02.414461 28393 mini_ranger_kms.cc:401] 127.27.186.84:46607/kms/v1/keys
Aug 11 16:44:02 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466642, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.186.84@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
Aug 11 16:44:02 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466642, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.186.84@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
Aug 11 16:44:05 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:44:05.459882 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34773
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:34643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:34773
--ranger_config_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:46607/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:44:05.575040 14440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:05.575251 14440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:05.575273 14440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:05.576421 14440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:44:05.576462 14440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:05.576478 14440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:05.576489 14440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:44:05.576501 14440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:44:05.578200 14440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:34643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/wal
--ranger_kms_url=127.27.186.84:46607/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:34773
--ranger_config_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:05.578460 14440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:05.578711 14440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:05.585250 14448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:05.585242 14450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:05.585364 14457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:05.585268 14440 server_base.cc:1034] running on GCE node
I20260811 16:44:05.585877 14440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:05.586242 14440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:05.587427 14440 hybrid_clock.cc:648] HybridClock initialized: now 1786466645587411 us; error 37 us; skew 500 ppm
Aug 11 16:44:05 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466645, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:05.590940 14440 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:44:05.591506 14440 webserver.cc:460] Webserver started at http://127.27.186.126:38547/ using document root <none> and password file <none>
I20260811 16:44:05.591764 14440 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:05.591821 14440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:44:05.591959 14440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:44:05 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466645, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:05.638347 14440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "6f777f9a74604786b8cf731e612892c0"
format_stamp: "Formatted at 2026-08-11 16:44:05 on dist-test-slave-gsp7"
server_key: "f638c226a2cbf7994315583d0e1e3966"
server_key_iv: "198ed36cfaca6af6470ba41d505e0cc3"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:05.638779 14440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "6f777f9a74604786b8cf731e612892c0"
format_stamp: "Formatted at 2026-08-11 16:44:05 on dist-test-slave-gsp7"
server_key: "f638c226a2cbf7994315583d0e1e3966"
server_key_iv: "198ed36cfaca6af6470ba41d505e0cc3"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:05.640421 14440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:44:05.655668 14470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:05.656216 14440 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:05.656353 14440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "6f777f9a74604786b8cf731e612892c0"
format_stamp: "Formatted at 2026-08-11 16:44:05 on dist-test-slave-gsp7"
server_key: "f638c226a2cbf7994315583d0e1e3966"
server_key_iv: "198ed36cfaca6af6470ba41d505e0cc3"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:05.656484 14440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:05.665033 14440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:05.666925 14440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:05.667098 14440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:05.673313 14440 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:34773
I20260811 16:44:05.673362 14565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:34773 every 8 connection(s)
I20260811 16:44:05.673800 14440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:44:05.674557 14566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:44:05.676983 14566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0: Bootstrap starting.
I20260811 16:44:05.677513 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 14440
I20260811 16:44:05.677685 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:44:05.677888 28393 external_mini_cluster.cc:1428] Setting key dc12e80c88e1ddb3693f72172434134c
I20260811 16:44:05.678097 14566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0: Neither blocks nor log segments found. Creating new log.
I20260811 16:44:05.678514 14566 log.cc:824] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:05.679454 14566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0: No bootstrap required, opened a new log
I20260811 16:44:05.681759 14566 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f777f9a74604786b8cf731e612892c0" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34773 } }
I20260811 16:44:05.681964 14566 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:44:05.681999 14566 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f777f9a74604786b8cf731e612892c0, State: Initialized, Role: FOLLOWER
I20260811 16:44:05.682157 14566 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f777f9a74604786b8cf731e612892c0" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34773 } }
I20260811 16:44:05.682266 14566 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:44:05.682319 14566 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:44:05.682399 14566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:44:05.683154 14566 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f777f9a74604786b8cf731e612892c0" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34773 } }
I20260811 16:44:05.683265 14566 leader_election.cc:302] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f777f9a74604786b8cf731e612892c0; no voters:
I20260811 16:44:05.683450 14566 leader_election.cc:288] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:44:05.683525 14572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:44:05.683736 14572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [term 1 LEADER]: Becoming Leader. State: Replica: 6f777f9a74604786b8cf731e612892c0, State: Running, Role: LEADER
I20260811 16:44:05.683851 14566 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:44:05.683881 14572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f777f9a74604786b8cf731e612892c0" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34773 } }
I20260811 16:44:05.684329 14572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f777f9a74604786b8cf731e612892c0. Latest consensus state: current_term: 1 leader_uuid: "6f777f9a74604786b8cf731e612892c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f777f9a74604786b8cf731e612892c0" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34773 } } }
I20260811 16:44:05.684494 14572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [sys.catalog]: This master's current role is: LEADER
I20260811 16:44:05.684793 14585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 11 16:44:05 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:05.686309 14585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:44:05.686574 14566 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:44:05.687186 14577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f777f9a74604786b8cf731e612892c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f777f9a74604786b8cf731e612892c0" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34773 } } }
I20260811 16:44:05.687263 14577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0 [sys.catalog]: This master's current role is: LEADER
I20260811 16:44:05.692104 14585 catalog_manager.cc:1347] Generated new cluster ID: aa227a5456d849b29dbb0ac2adec4930
I20260811 16:44:05.692268 14585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:44:05.695163 14570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:05.678496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.27.186.126:34773)
0811 16:44:05.678874 (+ 378us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:05.678884 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:05.678923 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:44:05.679424 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:05.679432 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:05.679484 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:05.679657 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:05.680321 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:05.682052 (+ 1731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:05.683034 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:05.683660 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:05.684101 (+ 441us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:05.686867 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:05.686871 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:05.686872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:05.686884 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:05.691984 (+ 5100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:05.692560 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:05.692570 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:05.692571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:05.692769 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:05.693021 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:05.693022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:05.693022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:05.693549 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:05.693801 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:05.694292 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 16:44:05.694819 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":87,"threads_started":1}
I20260811 16:44:05.744941 14585 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:44:05.745847 14585 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:44:05.759903 14585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0: Generated new TSK 0
I20260811 16:44:05.760211 14585 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:44:06.493454 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:46607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34773
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:34643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:44:06.596892 14651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:06.597111 14651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:06.597136 14651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:06.598354 14651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:06.598399 14651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:06.598433 14651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:44:06.599994 14651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:34643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.27.186.84:46607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:06.600241 14651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:06.600492 14651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:06.607225 14665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:06.607437 14651 server_base.cc:1034] running on GCE node
W20260811 16:44:06.607218 14661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:06.607239 14659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:06.607713 14651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:06.607987 14651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:06.609146 14651 hybrid_clock.cc:648] HybridClock initialized: now 1786466646609127 us; error 36 us; skew 500 ppm
Aug 11 16:44:06 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466646, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:06.612493 14651 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:44:06.613034 14651 webserver.cc:460] Webserver started at http://127.27.186.65:39631/ using document root <none> and password file <none>
I20260811 16:44:06.613286 14651 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:06.613333 14651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:44:06.613525 14651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:44:06 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466646, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:06.633108 14651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1"
format_stamp: "Formatted at 2026-08-11 16:44:06 on dist-test-slave-gsp7"
server_key: "303a0317003aad694300cc43ee5416fe"
server_key_iv: "837bda6ec91a3a06562b522244dd899e"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:06.633606 14651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1"
format_stamp: "Formatted at 2026-08-11 16:44:06 on dist-test-slave-gsp7"
server_key: "303a0317003aad694300cc43ee5416fe"
server_key_iv: "837bda6ec91a3a06562b522244dd899e"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:06.635526 14651 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 16:44:06.651281 14682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:06.651492 14651 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:06.651589 14651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1"
format_stamp: "Formatted at 2026-08-11 16:44:06 on dist-test-slave-gsp7"
server_key: "303a0317003aad694300cc43ee5416fe"
server_key_iv: "837bda6ec91a3a06562b522244dd899e"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:06.651682 14651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:06.679088 14651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:06.681216 14651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:06.681406 14651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:06.681664 14651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:06.682008 14651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:06.682065 14651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:06.682104 14651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:06.682132 14651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:06.690586 14651 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:39937
I20260811 16:44:06.690752 14907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:39937 every 8 connection(s)
I20260811 16:44:06.691118 14651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:44:06.691519 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 14651
I20260811 16:44:06.691637 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:44:06.691875 28393 external_mini_cluster.cc:1428] Setting key 1a10293d2a108743692ae669c47e3cd4
Aug 11 16:44:06 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466646, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:06.703505 14912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:06.694072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:57101 (local address 127.27.186.126:34773)
0811 16:44:06.694227 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:06.694229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:06.694240 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:44:06.694860 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:06.694861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:06.694875 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:06.694942 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:06.695662 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:06.696458 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:06.697707 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:06.697907 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:06.697996 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:06.700371 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:06.700372 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:06.700373 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:06.700380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:06.702048 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:06.702482 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:06.702483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:06.702484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:06.702553 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:06.702818 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:06.702819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:06.702819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:06.702944 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:06.703015 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:06.703306 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 16:44:06.703407 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260811 16:44:06.703663 14911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:06.692876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34773 (local address 127.27.186.65:57101)
0811 16:44:06.693895 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:06.693947 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:06.694695 (+ 748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:06.695086 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:06.695091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:06.695320 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:06.695559 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:06.695564 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:06.696582 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:06.696583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:06.697604 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:06.697607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:06.698002 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:06.698003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:06.698135 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:06.698698 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:06.698707 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:06.700256 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:06.702157 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:06.702164 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:06.702167 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:06.702398 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:06.702623 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:06.702624 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:06.702624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:06.702740 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:06.703018 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:06.703025 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:06.703167 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 16:44:06.703271 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 16:44:06.703420 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":967,"thread_start_us":94,"threads_started":1}
I20260811 16:44:06.704402 14908 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34773
I20260811 16:44:06.704499 14908 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:06.704684 14908 heartbeater.cc:511] Master 127.27.186.126:34773 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
I20260811 16:44:06.705224 14496 ts_manager.cc:194] Registered new tserver with Master: 12e8762c81b44ecc8e10e2b9e4bfa9f1 (127.27.186.65:39937)
I20260811 16:44:06.706177 14496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:57101
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:44:06.732707 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:46607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34773
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:34643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:44:06.863196 14919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:06.863441 14919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:06.863483 14919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:06.864725 14919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:06.864791 14919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:06.864835 14919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:44:06.866420 14919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:34643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.27.186.84:46607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:06.866683 14919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:06.866945 14919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:06.872525 14931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:06.872751 14932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:06.872525 14934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:06.873344 14919 server_base.cc:1034] running on GCE node
I20260811 16:44:06.873580 14919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:06.873860 14919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:06.875028 14919 hybrid_clock.cc:648] HybridClock initialized: now 1786466646875019 us; error 34 us; skew 500 ppm
Aug 11 16:44:06 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466646, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:06.878186 14919 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:44:06.878703 14919 webserver.cc:460] Webserver started at http://127.27.186.66:46105/ using document root <none> and password file <none>
I20260811 16:44:06.878942 14919 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:06.879011 14919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:44:06.879163 14919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:44:06 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466646, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:06.905597 14919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "62dc1f41d6494ea698f874fa3cedf2d7"
format_stamp: "Formatted at 2026-08-11 16:44:06 on dist-test-slave-gsp7"
server_key: "e084770376adcc88258f11b8d0b300b0"
server_key_iv: "69f833e843011ab615a84fb9a4840686"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:06.906503 14919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "62dc1f41d6494ea698f874fa3cedf2d7"
format_stamp: "Formatted at 2026-08-11 16:44:06 on dist-test-slave-gsp7"
server_key: "e084770376adcc88258f11b8d0b300b0"
server_key_iv: "69f833e843011ab615a84fb9a4840686"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:06.909258 14919 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
Aug 11 16:44:06 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466646, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:06.925864 14950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:06.926551 14919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 16:44:06.926704 14919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "62dc1f41d6494ea698f874fa3cedf2d7"
format_stamp: "Formatted at 2026-08-11 16:44:06 on dist-test-slave-gsp7"
server_key: "e084770376adcc88258f11b8d0b300b0"
server_key_iv: "69f833e843011ab615a84fb9a4840686"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:06.926884 14919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:06.952275 14919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:06.955330 14919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:06.955554 14919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:06.955832 14919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:06.956421 14919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:06.956530 14919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:06.956614 14919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:06.956686 14919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:06.967828 14919 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:43941
I20260811 16:44:06.968372 14919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:44:06.971347 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 14919
I20260811 16:44:06.971469 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:44:06.971659 28393 external_mini_cluster.cc:1428] Setting key caae5d295c87e6a20fa53b92fa992a9a
Aug 11 16:44:06 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466646, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:06.978581 15163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:43941 every 8 connection(s)
I20260811 16:44:06.981398 14912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:06.969331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:51381 (local address 127.27.186.126:34773)
0811 16:44:06.970715 (+ 1384us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:06.970718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:06.970732 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:44:06.970955 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:06.970956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:06.970973 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:06.971061 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:06.971961 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:06.972741 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:06.974349 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:06.974666 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:06.974712 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:06.977448 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:06.977450 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:06.977450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:06.977458 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:06.979511 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:06.980156 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:06.980158 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:06.980158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:06.980250 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:06.980562 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:06.980563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:06.980563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:06.980697 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:06.980758 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:06.981207 (+ 449us) server_negotiation.cc:299] Negotiation successful
0811 16:44:06.981303 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1356}
I20260811 16:44:06.982287 15170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:06.969240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34773 (local address 127.27.186.66:51381)
0811 16:44:06.970084 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:06.970152 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:06.970833 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:06.971138 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:06.971143 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:06.971410 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:06.971729 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:06.971735 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:06.972866 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:06.972867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:06.974227 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:06.974230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:06.974805 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:06.974806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:06.974952 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:06.975628 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:06.975638 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:06.977331 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:06.979622 (+ 2291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:06.979628 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:06.979631 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:06.980039 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:06.980326 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:06.980327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:06.980327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:06.980479 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:06.980811 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:06.980817 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:06.981017 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 16:44:06.981820 (+ 803us) client_negotiation.cc:240] Negotiation successful
0811 16:44:06.982024 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"thread_start_us":566,"threads_started":1}
I20260811 16:44:06.983246 15164 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34773
I20260811 16:44:06.983340 15164 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:06.983572 15164 heartbeater.cc:511] Master 127.27.186.126:34773 requested a full tablet report, sending...
I20260811 16:44:06.984016 14496 ts_manager.cc:194] Registered new tserver with Master: 62dc1f41d6494ea698f874fa3cedf2d7 (127.27.186.66:43941)
I20260811 16:44:06.984499 14496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:51381
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:44:07.016600 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:46607/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34773
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:34643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:44:07.148851 15177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:07.149133 15177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:07.149169 15177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:07.151031 15177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:07.151091 15177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:07.151134 15177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:44:07.153709 15177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:34643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.27.186.84:46607/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:07.153967 15177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:07.154291 15177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:07.162012 15190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:07.162218 15185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:07.162021 15186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:07.163445 15177 server_base.cc:1034] running on GCE node
I20260811 16:44:07.163707 15177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:07.164122 15177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:07.165303 15177 hybrid_clock.cc:648] HybridClock initialized: now 1786466647165270 us; error 47 us; skew 500 ppm
Aug 11 16:44:07 dist-test-slave-gsp7 krb5kdc[13650](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466647, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:07.169070 15177 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:44:07.169754 15177 webserver.cc:460] Webserver started at http://127.27.186.67:34405/ using document root <none> and password file <none>
I20260811 16:44:07.170143 15177 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:07.170287 15177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:44:07.170511 15177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:44:07 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466647, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:07.185287 15177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "5cebe3e98be245499948ba30e4bd3838"
format_stamp: "Formatted at 2026-08-11 16:44:07 on dist-test-slave-gsp7"
server_key: "ece6f049c7c901b611cff27d3038d222"
server_key_iv: "97616fa7f651d5cc76c37b68ae819e14"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:07.186003 15177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "5cebe3e98be245499948ba30e4bd3838"
format_stamp: "Formatted at 2026-08-11 16:44:07 on dist-test-slave-gsp7"
server_key: "ece6f049c7c901b611cff27d3038d222"
server_key_iv: "97616fa7f651d5cc76c37b68ae819e14"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:07.188125 15177 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 16:44:07.201328 15212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:07.201583 15177 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260811 16:44:07.201699 15177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "5cebe3e98be245499948ba30e4bd3838"
format_stamp: "Formatted at 2026-08-11 16:44:07 on dist-test-slave-gsp7"
server_key: "ece6f049c7c901b611cff27d3038d222"
server_key_iv: "97616fa7f651d5cc76c37b68ae819e14"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:07.201815 15177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:07.247669 15177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:07.250005 15177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:07.250198 15177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:07.250550 15177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:07.250964 15177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:07.251024 15177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:07.251061 15177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:07.251106 15177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:07.261445 15177 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:35733
I20260811 16:44:07.261580 15427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:35733 every 8 connection(s)
I20260811 16:44:07.261938 15177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:44:07.267127 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 15177
I20260811 16:44:07.267246 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:44:07.267448 28393 external_mini_cluster.cc:1428] Setting key c6ccda63ede32b9c3be5d8571a12f808
Aug 11 16:44:07 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466647, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:07.273236 14912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.262789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:43597 (local address 127.27.186.126:34773)
0811 16:44:07.262867 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:07.262878 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:07.263046 (+ 168us) server_negotiation.cc:407] Connection header received
0811 16:44:07.263718 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:07.263720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:07.263732 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:07.263814 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:07.264731 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.265463 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.266492 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.266838 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.266917 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.269793 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:07.269794 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:07.269795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:07.269812 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:07.271751 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:07.272168 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:07.272169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:07.272169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:07.272245 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:07.272514 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:07.272515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:07.272515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:07.272664 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:07.272736 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:07.273051 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 16:44:07.273142 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:44:07.273334 15431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.262704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34773 (local address 127.27.186.67:43597)
0811 16:44:07.262898 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:07.262941 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:07.263599 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:07.263883 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:07.263887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:07.264260 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:07.264598 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.264604 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.265570 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.265571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.266384 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.266387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.266950 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.266951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.267108 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.268022 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:07.268030 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:07.269677 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:07.271860 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:07.271866 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:07.271868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:07.272089 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:07.272341 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:07.272342 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:07.272342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:07.272446 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:07.272757 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:07.272763 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:07.272896 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 16:44:07.273006 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:44:07.273160 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":92,"threads_started":1}
I20260811 16:44:07.274128 15428 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34773
I20260811 16:44:07.274220 15428 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:07.274434 15428 heartbeater.cc:511] Master 127.27.186.126:34773 requested a full tablet report, sending...
I20260811 16:44:07.274878 14496 ts_manager.cc:194] Registered new tserver with Master: 5cebe3e98be245499948ba30e4bd3838 (127.27.186.67:35733)
I20260811 16:44:07.275355 14496 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:43597
I20260811 16:44:07.279558 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:44:07.289809 14912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.281503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42090 (local address 127.27.186.126:34773)
0811 16:44:07.281551 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:07.281553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:07.281794 (+ 241us) server_negotiation.cc:407] Connection header received
0811 16:44:07.281885 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:07.281887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:07.281897 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:07.281979 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:07.282674 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.283160 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.283902 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.284094 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.284175 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.286330 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:07.286331 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:07.286331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:07.286338 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:07.287882 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:07.288494 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:07.288495 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:07.288496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:07.288609 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:07.288942 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:07.288944 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:07.288944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:07.289093 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:07.289184 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:07.289425 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 16:44:07.289661 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:44:07.291917 14496 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42090:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:44:07.293919 14496 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:44:07.302295 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.296803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:43941 (local address 127.0.0.1:43250)
0811 16:44:07.297434 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:07.297443 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:07.297659 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:07.298185 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:07.298186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:07.298188 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:07.298241 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.298243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.299130 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.299131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.300947 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.300950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.301985 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.301986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.302081 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.302096 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 16:44:07.302142 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 16:44:07.302191 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":337,"thread_start_us":125,"threads_started":1}
I20260811 16:44:07.303484 15457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.297292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43250 (local address 127.27.186.66:43941)
0811 16:44:07.298039 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:07.298042 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:07.298050 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:44:07.298081 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:07.298082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:07.298094 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:07.298187 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:07.298292 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.299036 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.301073 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.301884 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.303137 (+ 1253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.303253 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:07.303282 (+ 29us) server_negotiation.cc:299] Negotiation successful
0811 16:44:07.303338 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":100,"threads_started":1}
I20260811 16:44:07.304405 15008 tablet_service.cc:1467] Processing CreateTablet for tablet 78ccd2a76d60415d85c6328fbe962529 (DEFAULT_TABLE table=test-table [id=621e946936584b6aa71f9666cce5c40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:44:07.304822 15008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78ccd2a76d60415d85c6328fbe962529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:44:07.309363 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.296933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:35733 (local address 127.0.0.1:47452)
0811 16:44:07.299228 (+ 2295us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:07.299238 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:07.299289 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:07.299664 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:07.299665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:07.299667 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:07.299708 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.299710 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.301087 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.301087 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.302197 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.302199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.303598 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.303600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.303661 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.303665 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:44:07.303716 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:44:07.309249 (+ 5533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2262,"thread_start_us":110,"threads_started":1}
I20260811 16:44:07.309945 15456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.297268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47452 (local address 127.27.186.67:35733)
0811 16:44:07.297789 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:07.297792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:07.299361 (+ 1569us) server_negotiation.cc:407] Connection header received
0811 16:44:07.299434 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:07.299436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:07.299452 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:07.299528 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:07.299797 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.301001 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.302451 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.303374 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.303443 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.303555 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:07.309742 (+ 6187us) server_negotiation.cc:299] Negotiation successful
0811 16:44:07.309799 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":114,"threads_started":1}
I20260811 16:44:07.310580 15299 tablet_service.cc:1467] Processing CreateTablet for tablet 78ccd2a76d60415d85c6328fbe962529 (DEFAULT_TABLE table=test-table [id=621e946936584b6aa71f9666cce5c40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:44:07.310925 15299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78ccd2a76d60415d85c6328fbe962529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:44:07.316303 15448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.296791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:39937 (local address 127.0.0.1:35654)
0811 16:44:07.297183 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:07.297228 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:07.297297 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:07.297782 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:07.297786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:07.297788 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:07.297855 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.297858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.299566 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.299567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.315256 (+ 15689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.315260 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.316035 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.316037 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.316106 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.316111 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:44:07.316174 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 16:44:07.316226 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":109,"threads_started":1}
I20260811 16:44:07.316332 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.297093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35654 (local address 127.27.186.65:39937)
0811 16:44:07.297540 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:07.297545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:07.297556 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:44:07.297592 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:07.297595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:07.297613 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:07.297693 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:07.297945 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.299463 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.315380 (+ 15917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.315932 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.316034 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.316103 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:07.316190 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 16:44:07.316229 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":98,"threads_started":1}
I20260811 16:44:07.317252 14765 tablet_service.cc:1467] Processing CreateTablet for tablet 78ccd2a76d60415d85c6328fbe962529 (DEFAULT_TABLE table=test-table [id=621e946936584b6aa71f9666cce5c40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:44:07.317629 14765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78ccd2a76d60415d85c6328fbe962529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:44:07.319438 15458 tablet_bootstrap.cc:492] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: Bootstrap starting.
I20260811 16:44:07.320567 15460 tablet_bootstrap.cc:492] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1: Bootstrap starting.
I20260811 16:44:07.320709 15458 tablet_bootstrap.cc:654] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: Neither blocks nor log segments found. Creating new log.
I20260811 16:44:07.321815 15458 log.cc:824] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:07.322139 15459 tablet_bootstrap.cc:492] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Bootstrap starting.
I20260811 16:44:07.322921 15460 tablet_bootstrap.cc:654] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1: Neither blocks nor log segments found. Creating new log.
I20260811 16:44:07.323755 15460 log.cc:824] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:07.323871 15459 tablet_bootstrap.cc:654] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Neither blocks nor log segments found. Creating new log.
I20260811 16:44:07.324523 15459 log.cc:824] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:07.324637 15460 tablet_bootstrap.cc:492] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1: No bootstrap required, opened a new log
I20260811 16:44:07.324708 15460 ts_tablet_manager.cc:1397] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 16:44:07.325451 15458 tablet_bootstrap.cc:492] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: No bootstrap required, opened a new log
I20260811 16:44:07.325536 15458 ts_tablet_manager.cc:1397] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260811 16:44:07.328246 15458 raft_consensus.cc:348] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.328297 15460 raft_consensus.cc:348] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.328452 15460 raft_consensus.cc:374] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:44:07.328522 15460 raft_consensus.cc:729] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12e8762c81b44ecc8e10e2b9e4bfa9f1, State: Initialized, Role: FOLLOWER
I20260811 16:44:07.328549 15458 raft_consensus.cc:374] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:44:07.328675 15458 raft_consensus.cc:729] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62dc1f41d6494ea698f874fa3cedf2d7, State: Initialized, Role: FOLLOWER
I20260811 16:44:07.328699 15460 consensus_queue.cc:260] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.328890 15458 consensus_queue.cc:260] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.329130 15460 ts_tablet_manager.cc:1428] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 16:44:07.329339 14908 heartbeater.cc:503] Master 127.27.186.126:34773 was elected leader, sending a full tablet report...
I20260811 16:44:07.330111 15164 heartbeater.cc:503] Master 127.27.186.126:34773 was elected leader, sending a full tablet report...
I20260811 16:44:07.331670 15459 tablet_bootstrap.cc:492] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: No bootstrap required, opened a new log
I20260811 16:44:07.331759 15459 ts_tablet_manager.cc:1397] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260811 16:44:07.333448 15458 ts_tablet_manager.cc:1428] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: Time spent starting tablet: real 0.008s user 0.003s sys 0.001s
I20260811 16:44:07.335914 15459 raft_consensus.cc:348] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.336128 15459 raft_consensus.cc:374] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:44:07.336169 15459 raft_consensus.cc:729] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cebe3e98be245499948ba30e4bd3838, State: Initialized, Role: FOLLOWER
I20260811 16:44:07.336292 15459 consensus_queue.cc:260] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.336596 15459 ts_tablet_manager.cc:1428] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260811 16:44:07.336648 15428 heartbeater.cc:503] Master 127.27.186.126:34773 was elected leader, sending a full tablet report...
W20260811 16:44:07.443039 14909 tablet.cc:2369] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 16:44:07 dist-test-slave-gsp7 krb5kdc[13650](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466646, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
W20260811 16:44:07.479372 15169 tablet.cc:2369] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:44:07.512651 15430 tablet.cc:2369] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:44:07.584034 15472 raft_consensus.cc:482] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:44:07.584174 15472 raft_consensus.cc:504] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.584810 15472 leader_election.cc:288] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12e8762c81b44ecc8e10e2b9e4bfa9f1 (127.27.186.65:39937), 62dc1f41d6494ea698f874fa3cedf2d7 (127.27.186.66:43941)
I20260811 16:44:07.588697 15431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.584960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:39937 (local address 127.27.186.67:51993)
0811 16:44:07.584995 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:07.585012 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:07.585062 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:07.585370 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:07.585371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:07.585374 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:07.585445 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.585448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.586453 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.586453 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.587755 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.587758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.588420 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.588421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.588496 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.588499 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:44:07.588578 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:44:07.588624 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15,"mutex_wait_us":58}
I20260811 16:44:07.588696 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.585089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:51993 (local address 127.27.186.65:39937)
0811 16:44:07.585142 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:07.585144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:07.585152 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:44:07.585179 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:07.585180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:07.585193 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:07.585251 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:07.585596 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.586367 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.587923 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.588331 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.588423 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.588433 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:07.588585 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 16:44:07.588624 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:44:07.589272 14773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78ccd2a76d60415d85c6328fbe962529" candidate_uuid: "5cebe3e98be245499948ba30e4bd3838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" is_pre_election: true
I20260811 16:44:07.589560 14773 raft_consensus.cc:2454] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cebe3e98be245499948ba30e4bd3838 in term 0.
I20260811 16:44:07.589896 15473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.585048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:43941 (local address 127.27.186.67:41373)
0811 16:44:07.585361 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:07.585371 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:07.585429 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:07.585623 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:07.585624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:07.585626 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:07.585752 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.585754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.586370 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.586372 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.587857 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:07.587860 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.589550 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.589551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:07.589649 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.589655 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:44:07.589741 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:44:07.589782 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":42,"thread_start_us":101,"threads_started":1}
I20260811 16:44:07.589890 15457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.585297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:41373 (local address 127.27.186.66:43941)
0811 16:44:07.585376 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:07.585378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:07.585427 (+ 49us) server_negotiation.cc:407] Connection header received
0811 16:44:07.585553 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:07.585554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:07.585565 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:07.585609 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:07.585816 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.586280 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.588016 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.588875 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.589020 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.589031 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:07.589754 (+ 723us) server_negotiation.cc:299] Negotiation successful
0811 16:44:07.589799 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:44:07.589973 15219 leader_election.cc:302] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12e8762c81b44ecc8e10e2b9e4bfa9f1, 5cebe3e98be245499948ba30e4bd3838; no voters:
I20260811 16:44:07.590219 15472 raft_consensus.cc:2781] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:44:07.590296 15472 raft_consensus.cc:482] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:44:07.590322 15472 raft_consensus.cc:3037] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:44:07.590706 15075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78ccd2a76d60415d85c6328fbe962529" candidate_uuid: "5cebe3e98be245499948ba30e4bd3838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" is_pre_election: true
I20260811 16:44:07.590862 15075 raft_consensus.cc:2454] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cebe3e98be245499948ba30e4bd3838 in term 0.
I20260811 16:44:07.591522 15472 raft_consensus.cc:504] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.591657 15472 leader_election.cc:288] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [CANDIDATE]: Term 1 election: Requested vote from peers 12e8762c81b44ecc8e10e2b9e4bfa9f1 (127.27.186.65:39937), 62dc1f41d6494ea698f874fa3cedf2d7 (127.27.186.66:43941)
I20260811 16:44:07.591801 15075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78ccd2a76d60415d85c6328fbe962529" candidate_uuid: "5cebe3e98be245499948ba30e4bd3838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62dc1f41d6494ea698f874fa3cedf2d7"
I20260811 16:44:07.591853 14773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78ccd2a76d60415d85c6328fbe962529" candidate_uuid: "5cebe3e98be245499948ba30e4bd3838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1"
I20260811 16:44:07.591908 15075 raft_consensus.cc:3037] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:44:07.591954 14773 raft_consensus.cc:3037] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:44:07.592623 15075 raft_consensus.cc:2454] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cebe3e98be245499948ba30e4bd3838 in term 1.
I20260811 16:44:07.592787 15220 leader_election.cc:302] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cebe3e98be245499948ba30e4bd3838, 62dc1f41d6494ea698f874fa3cedf2d7; no voters:
I20260811 16:44:07.592883 15472 raft_consensus.cc:2781] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:44:07.593027 15472 raft_consensus.cc:686] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 1 LEADER]: Becoming Leader. State: Replica: 5cebe3e98be245499948ba30e4bd3838, State: Running, Role: LEADER
I20260811 16:44:07.593096 15472 consensus_queue.cc:237] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } }
I20260811 16:44:07.593533 14773 raft_consensus.cc:2454] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cebe3e98be245499948ba30e4bd3838 in term 1.
I20260811 16:44:07.594084 14496 catalog_manager.cc:5495] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cebe3e98be245499948ba30e4bd3838 (127.27.186.67). New cstate: current_term: 1 leader_uuid: "5cebe3e98be245499948ba30e4bd3838" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cebe3e98be245499948ba30e4bd3838" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35733 } health_report { overall_health: HEALTHY } } }
I20260811 16:44:07.659322 15456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.655797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47454 (local address 127.27.186.67:35733)
0811 16:44:07.655879 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:07.655881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:07.655889 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:44:07.655937 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:07.655938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:07.655960 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:07.656043 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:44:07.656239 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.657047 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.658216 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:07.658526 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:07.658611 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:07.658821 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:44:07.658957 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:44:07.659068 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:07.659204 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 16:44:07.659233 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 16:44:07.661867 14773 raft_consensus.cc:1261] T 78ccd2a76d60415d85c6328fbe962529 P 12e8762c81b44ecc8e10e2b9e4bfa9f1 [term 1 FOLLOWER]: Refusing update from remote peer 5cebe3e98be245499948ba30e4bd3838: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:44:07.662232 15075 raft_consensus.cc:1261] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 1 FOLLOWER]: Refusing update from remote peer 5cebe3e98be245499948ba30e4bd3838: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:44:07.662297 15472 consensus_queue.cc:1035] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12e8762c81b44ecc8e10e2b9e4bfa9f1" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:44:07.662748 15472 consensus_queue.cc:1035] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62dc1f41d6494ea698f874fa3cedf2d7" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:44:07.667085 15480 mvcc.cc:205] Tried to move back new op lower bound from 7317367388819566592 to 7317367388541681664. Current Snapshot: MvccSnapshot[applied={T|T < 7317367388819566592}]
I20260811 16:44:07.667372 15486 mvcc.cc:205] Tried to move back new op lower bound from 7317367388819566592 to 7317367388541681664. Current Snapshot: MvccSnapshot[applied={T|T < 7317367388819566592}]
I20260811 16:44:07.669046 15481 mvcc.cc:205] Tried to move back new op lower bound from 7317367388819566592 to 7317367388541681664. Current Snapshot: MvccSnapshot[applied={T|T < 7317367388819566592}]
I20260811 16:44:07.672297 14496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:44:07.672401 14496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42090:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:44:07.675125 14496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f777f9a74604786b8cf731e612892c0: Sending DeleteTablet for 3 replicas of tablet 78ccd2a76d60415d85c6328fbe962529
I20260811 16:44:07.675607 14765 tablet_service.cc:1514] Processing DeleteTablet for tablet 78ccd2a76d60415d85c6328fbe962529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:44:07 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:35654
I20260811 16:44:07.676266 15008 tablet_service.cc:1514] Processing DeleteTablet for tablet 78ccd2a76d60415d85c6328fbe962529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:44:07 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:43250
I20260811 16:44:07.676842 15299 tablet_service.cc:1514] Processing DeleteTablet for tablet 78ccd2a76d60415d85c6328fbe962529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:44:07 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:47452
I20260811 16:44:07.677318 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 14651
I20260811 16:44:07.689976 15497 tablet_replica.cc:330] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: stopping tablet replica
I20260811 16:44:07.690205 15500 tablet_replica.cc:330] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: stopping tablet replica
I20260811 16:44:07.693076 15500 raft_consensus.cc:2229] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:44:07.693284 15500 raft_consensus.cc:2258] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:44:07.693522 15497 raft_consensus.cc:2229] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:44:07.693727 15497 raft_consensus.cc:2258] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:44:07.694523 15500 ts_tablet_manager.cc:1905] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:44:07.694868 15497 ts_tablet_manager.cc:1905] T 78ccd2a76d60415d85c6328fbe962529 P 62dc1f41d6494ea698f874fa3cedf2d7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 16:44:07.695225 14473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:39937 (error 108)
I20260811 16:44:07.696280 15448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:07.696139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:39937 (local address 127.0.0.1:35662)
0811 16:44:07.696198 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:07.696235 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:39937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 16:44:07.696506 14473 catalog_manager.cc:4584] TS 12e8762c81b44ecc8e10e2b9e4bfa9f1 (127.27.186.65:39937): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78ccd2a76d60415d85c6328fbe962529: Network error: Client connection negotiation failed: client connection to 127.27.186.65:39937: connect: Connection refused (error 111)
I20260811 16:44:07.696774 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 14919
I20260811 16:44:07.704011 15500 ts_tablet_manager.cc:1918] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:44:07.704160 15500 log.cc:1196] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/78ccd2a76d60415d85c6328fbe962529
I20260811 16:44:07.704541 15500 ts_tablet_manager.cc:1939] T 78ccd2a76d60415d85c6328fbe962529 P 5cebe3e98be245499948ba30e4bd3838: Deleting consensus metadata
I20260811 16:44:07.705271 14471 catalog_manager.cc:4841] TS 5cebe3e98be245499948ba30e4bd3838 (127.27.186.67:35733): tablet 78ccd2a76d60415d85c6328fbe962529 (table test-table [id=621e946936584b6aa71f9666cce5c40c]) successfully deleted
W20260811 16:44:07.709095 15448 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:44:07.708712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:43941 (local address 127.0.0.1:43258)
0811 16:44:07.708760 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:07.708772 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:07.708813 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:07.709041 (+ 228us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.66:43941: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 16:44:07.709780 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 15177
I20260811 16:44:07.740378 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 14440
I20260811 16:44:07.750502 28393 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 16:44:08.095569 28393 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 16:44:08.095676 28393 mini_ranger.cc:66] Stopping Ranger...
I20260811 16:44:08.450290 28393 mini_ranger.cc:68] Stopped Ranger
2026-08-11 16:44:08.450 UTC [13709] LOG: received smart shutdown request
2026-08-11 16:44:08.454 UTC [13709] LOG: background worker "logical replication launcher" (PID 13719) exited with exit code 1
2026-08-11 16:44:08.454 UTC [13713] LOG: shutting down
2026-08-11 16:44:08.633 UTC [13709] LOG: database system is shut down
2026-08-11T16:44:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50209 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:44:08 dist-test-slave-gsp7 krb5kdc[15517](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:44:08 dist-test-slave-gsp7 krb5kdc[15517](info): set up 2 sockets
Aug 11 16:44:08 dist-test-slave-gsp7 krb5kdc[15517](info): commencing operation
krb5kdc: starting...
W20260811 16:44:10.030706 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:44:10 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:44:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:44:10Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.27.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.27.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/rangeradmin_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/rangeradmin_127.27.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.27.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.27.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/rangerlookup_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/rangerlookup_127.27.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.27.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/HTTP_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/HTTP_127.27.186.84@KRBTEST.COM.keytab.
I20260811 16:44:10.212011 28393 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJargcS/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/postgres -l logfile start
2026-08-11 16:44:12.807 UTC [15575] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 16:44:12.807 UTC [15575] LOG: listening on IPv4 address "127.27.186.84", port 36203
2026-08-11 16:44:12.810 UTC [15575] LOG: listening on Unix socket "/tmp/.s.PGSQL.36203"
2026-08-11 16:44:12.833 UTC [15583] LOG: database system was shut down at 2026-08-11 16:44:11 UTC
2026-08-11 16:44:12.837 UTC [15575] LOG: database system is ready to accept connections
I20260811 16:44:14.006188 28393 mini_postgres.cc:96] Postgres bound to 36203
2026-08-11 16:44:14.013 UTC [15602] FATAL: database "slave" does not exist
127.27.186.84:36203 - accepting connections
I20260811 16:44:14.013904 28393 mini_ranger.cc:161] Starting Ranger...
I20260811 16:44:14.029820 28393 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 16:44:14.544287 28393 mini_ranger.cc:87] Created ranger Postgres database
I20260811 16:44:14.544378 28393 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-admin
2026-08-11 16:44:14,828 [I] DB FLAVOR :POSTGRES
2026-08-11 16:44:14,828 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:44:14,828 [I] Checking connection..
2026-08-11 16:44:14,828 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 16:44:15,069 [I] Checking connection passed.
2026-08-11 16:44:15,070 [I] --------- Verifying version history table ---------
2026-08-11 16:44:15,070 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:44:15,322 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:44:15,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:44:15,570 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 16:44:15,570 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 16:44:15,570 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 16:44:15.832 UTC [15707] WARNING: there is no transaction in progress
2026-08-11 16:44:15,841 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 16:44:15,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 16:44:16,112 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 16:44:16,113 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:44:16,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 16:44:16,389 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 16:44:16,637 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gsp7.c.gcp-upstream.internal','N') ;"
2026-08-11 16:44:16,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:44:17,133 [I] Table x_portal_user does not exist in database ranger
2026-08-11 16:44:17,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:44:17,409 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 16:44:17,409 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:44:17,681 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:44:17,939 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 16:44:17,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 16:44:18.927 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:18.943 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:18.959 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:18.974 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:18.993 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.011 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.069 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.077 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.092 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.103 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.114 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.130 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.141 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.148 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.155 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19.161 UTC [15917] WARNING: there is no transaction in progress
2026-08-11 16:44:19,816 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 16:44:19,817 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 16:44:20,081 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 16:44:20,081 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 16:44:20,354 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 16:44:20,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 16:44:20,623 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 16:44:20,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 16:44:20,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 16:44:21,159 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gsp7.c.gcp-upstream.internal';"
2026-08-11 16:44:21,418 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 16:44:21,419 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 16:44:21,657 [I] DB_PATCHES have already been applied
I20260811 16:44:21.663820 28393 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJargcS/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 16:44:21.663889 28393 mini_ranger.cc:193] Using host: 127.27.186.84
I20260811 16:44:21.667902 28393 mini_ranger.cc:227] Ranger admin URL: http://127.27.186.84:45381
Aug 11, 2026 4:44:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:44:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:44:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 4:44:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 4:44:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 4:44:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 4:44:22 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 16:44:23.067108 28393 mini_ranger.cc:160] Time spent starting Ranger: real 9.053s user 0.001s sys 0.010s
Aug 11, 2026 4:44:43 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 4:44:43 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 4:44:43 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 4:44:44 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 4:44:44 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 16:44:45.577472 28393 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.27.186.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.27.186.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/rangerkms_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.27.186.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/rangerkms_127.27.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.27.186.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.27.186.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.27.186.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/HTTP_127.27.186.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.27.186.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/HTTP_127.27.186.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 16:44:45 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466685, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 16:44:45.660883 28393 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 16:44:45.670620 28393 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 16:44:46.577831 28393 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 16:44:46.577900 28393 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms
I20260811 16:44:46.577913 28393 mini_ranger_kms.cc:227] Using postgres at 127.27.186.84:36203
2026-08-11 16:44:46,763 [I] DB FLAVOR :POSTGRES
2026-08-11 16:44:46,763 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 16:44:46,763 [I] Checking connection
2026-08-11 16:44:46,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 16:44:47,001 [I] connection success
2026-08-11 16:44:47,001 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 16:44:47,001 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 16:44:47,001 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 16:44:47,240 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 16:44:47,241 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 16:44:47,241 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 16:44:47,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.27.186.84:36203/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 16:44:47,518 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 16:44:47.989354 28393 mini_ranger_kms.cc:310] Created kms service
I20260811 16:44:48.186084 28393 mini_ranger_kms.cc:326] Created kudu user
I20260811 16:44:48.234469 28393 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 16:44:48 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466685, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:48.693594 28393 mini_ranger_kms.cc:384] Added ranger policy
I20260811 16:44:48.693809 28393 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJargcS/build/release/bin/postgresql.jar:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJargcS/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 16:44:48.693835 28393 mini_ranger_kms.cc:240] Using host: 127.27.186.84
I20260811 16:44:48.698319 28393 mini_ranger_kms.cc:276] Ranger KMS PID: 16244
I20260811 16:44:48.698400 28393 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.27.186.84:43151
Aug 11, 2026 4:44:49 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:44:49 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:44:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 4:44:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 4:44:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 4:44:50 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 16:44:51 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466691, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.186.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:51.485919 28393 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.825s user 0.005s sys 0.164s
I20260811 16:44:51.486018 28393 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 16:44:51.486064 28393 mini_ranger_kms.cc:401] 127.27.186.84:43151/kms/v1/keys
Aug 11 16:44:51 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466691, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.186.84@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
Aug 11 16:44:52 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466691, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.27.186.84@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
Aug 11 16:44:54 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:44:54.470645 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:33821
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:33821
--ranger_config_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:43151/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:44:54.556294 16338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:54.556512 16338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:54.556535 16338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:54.557770 16338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:44:54.557816 16338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:54.557829 16338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:54.557842 16338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:44:54.557854 16338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:44:54.559782 16338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
--ranger_kms_url=127.27.186.84:43151/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:33821
--ranger_config_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:33821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:54.560045 16338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:54.560285 16338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:54.567178 16344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:54.567216 16338 server_base.cc:1034] running on GCE node
W20260811 16:44:54.567224 16348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:54.567198 16345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:54.567683 16338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:54.568022 16338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:54.569193 16338 hybrid_clock.cc:648] HybridClock initialized: now 1786466694569169 us; error 41 us; skew 500 ppm
Aug 11 16:44:54 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466694, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:54.572103 16338 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:44:54.572676 16338 webserver.cc:460] Webserver started at http://127.27.186.126:42325/ using document root <none> and password file <none>
I20260811 16:44:54.572950 16338 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:54.573004 16338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:44:54.573143 16338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:44:54 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466694, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:54.629329 16338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "5faaad2b004740a0812f0a4ab803dd7c"
format_stamp: "Formatted at 2026-08-11 16:44:54 on dist-test-slave-gsp7"
server_key: "a264a6afa30934a0b6624b416914fd7b"
server_key_iv: "e0285d96aab7a201eb515193131ba538"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:54.629830 16338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "5faaad2b004740a0812f0a4ab803dd7c"
format_stamp: "Formatted at 2026-08-11 16:44:54 on dist-test-slave-gsp7"
server_key: "a264a6afa30934a0b6624b416914fd7b"
server_key_iv: "e0285d96aab7a201eb515193131ba538"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:54.631481 16338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:44:54.646229 16360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:54.646421 16338 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:44:54.646529 16338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "5faaad2b004740a0812f0a4ab803dd7c"
format_stamp: "Formatted at 2026-08-11 16:44:54 on dist-test-slave-gsp7"
server_key: "a264a6afa30934a0b6624b416914fd7b"
server_key_iv: "e0285d96aab7a201eb515193131ba538"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:54.646636 16338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:54.656343 16338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:54.658397 16338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:54.658551 16338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:54.663617 16338 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:33821
I20260811 16:44:54.663647 16451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:33821 every 8 connection(s)
I20260811 16:44:54.664021 16338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:44:54.664866 16457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:44:54.667528 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 16338
I20260811 16:44:54.667644 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:44:54.667835 28393 external_mini_cluster.cc:1428] Setting key 884e8c8589231e8a9c48616b433ed751
I20260811 16:44:54.668335 16457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Bootstrap starting.
I20260811 16:44:54.669176 16457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Neither blocks nor log segments found. Creating new log.
I20260811 16:44:54.669560 16457 log.cc:824] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:54.670459 16457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: No bootstrap required, opened a new log
I20260811 16:44:54.673089 16457 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } }
I20260811 16:44:54.673285 16457 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:44:54.673322 16457 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5faaad2b004740a0812f0a4ab803dd7c, State: Initialized, Role: FOLLOWER
I20260811 16:44:54.673537 16457 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } }
I20260811 16:44:54.673635 16457 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:44:54.673671 16457 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:44:54.673748 16457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:44:54.674489 16457 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } }
I20260811 16:44:54.674610 16457 leader_election.cc:302] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5faaad2b004740a0812f0a4ab803dd7c; no voters:
Aug 11 16:44:54 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466694, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:54.674837 16457 leader_election.cc:288] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:44:54.674888 16467 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:44:54.675128 16457 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:44:54.675625 16467 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 1 LEADER]: Becoming Leader. State: Replica: 5faaad2b004740a0812f0a4ab803dd7c, State: Running, Role: LEADER
I20260811 16:44:54.675791 16467 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } }
I20260811 16:44:54.676230 16467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5faaad2b004740a0812f0a4ab803dd7c. Latest consensus state: current_term: 1 leader_uuid: "5faaad2b004740a0812f0a4ab803dd7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } } }
I20260811 16:44:54.676384 16467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: This master's current role is: LEADER
I20260811 16:44:54.676678 16486 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:44:54.676995 16457 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:44:54.677263 16486 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:44:54.677634 16472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5faaad2b004740a0812f0a4ab803dd7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } } }
I20260811 16:44:54.679629 16472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: This master's current role is: LEADER
I20260811 16:44:54.682168 16465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:54.668391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.27.186.126:33821)
0811 16:44:54.668599 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:54.668608 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:54.668638 (+ 30us) server_negotiation.cc:407] Connection header received
0811 16:44:54.669094 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:54.669101 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:54.669149 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:54.669311 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:54.670248 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:54.671198 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:54.671990 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:54.672402 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:54.672539 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:54.675379 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:54.675384 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:54.675385 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:54.675398 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:54.677565 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:54.677913 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:54.677916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:54.677916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:54.678011 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:54.679549 (+ 1538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:54.679594 (+ 45us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:54.679594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:54.680824 (+ 1230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:54.681225 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:54.681345 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 16:44:54.681783 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":96,"threads_started":1}
I20260811 16:44:54.690102 16486 catalog_manager.cc:1347] Generated new cluster ID: f8a9249a25a0460b88f661750f82fd2c
I20260811 16:44:54.690220 16486 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:44:54.700001 16486 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:44:54.700774 16486 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:44:54.709615 16486 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Generated new TSK 0
I20260811 16:44:54.709904 16486 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:44:55.500841 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:43151/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33821
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:44:55.605731 16541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:55.605940 16541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:55.605989 16541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:55.607184 16541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:55.607266 16541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:55.607293 16541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:44:55.608793 16541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.27.186.84:43151/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:55.609033 16541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:55.609277 16541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:55.615784 16550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:55.615833 16552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:55.616041 16541 server_base.cc:1034] running on GCE node
W20260811 16:44:55.615775 16548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:55.616492 16541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:55.616817 16541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:55.621546 16541 hybrid_clock.cc:648] HybridClock initialized: now 1786466695621518 us; error 41 us; skew 500 ppm
Aug 11 16:44:55 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466695, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:55.625162 16541 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:44:55.625778 16541 webserver.cc:460] Webserver started at http://127.27.186.65:45815/ using document root <none> and password file <none>
I20260811 16:44:55.626098 16541 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:55.626179 16541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:44:55.626355 16541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:44:55 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466695, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:55.646778 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "683f768dac4544789a97a7ff0b4d5071"
format_stamp: "Formatted at 2026-08-11 16:44:55 on dist-test-slave-gsp7"
server_key: "39ba4f8ab374231e1a03ee74bb70d3fd"
server_key_iv: "af540d2cb7bf5ea1804f4533ec1d5c04"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:55.647269 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "683f768dac4544789a97a7ff0b4d5071"
format_stamp: "Formatted at 2026-08-11 16:44:55 on dist-test-slave-gsp7"
server_key: "39ba4f8ab374231e1a03ee74bb70d3fd"
server_key_iv: "af540d2cb7bf5ea1804f4533ec1d5c04"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:55.653982 16541 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260811 16:44:55.668483 16567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:55.668774 16541 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:55.668960 16541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "683f768dac4544789a97a7ff0b4d5071"
format_stamp: "Formatted at 2026-08-11 16:44:55 on dist-test-slave-gsp7"
server_key: "39ba4f8ab374231e1a03ee74bb70d3fd"
server_key_iv: "af540d2cb7bf5ea1804f4533ec1d5c04"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:55.669149 16541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:55.691560 16541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:55.693665 16541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:55.693812 16541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:55.694082 16541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:55.694461 16541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:55.694515 16541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:55.694555 16541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:55.694579 16541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:55.701928 16541 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:46685
I20260811 16:44:55.702096 16793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:46685 every 8 connection(s)
I20260811 16:44:55.702355 16541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:44:55.709090 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 16541
I20260811 16:44:55.709194 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:44:55.709386 28393 external_mini_cluster.cc:1428] Setting key 139065a0995e09343029c45e915af9d7
Aug 11 16:44:55 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466695, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:55.714147 16797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:55.703147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33821 (local address 127.27.186.65:36237)
0811 16:44:55.703342 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:55.703392 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:55.704050 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:55.704559 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:55.704564 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:55.704819 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:55.705117 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:55.705124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:55.706188 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:55.706189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:55.707478 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:55.707481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:55.707966 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:55.707967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:55.708107 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:55.708714 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:55.708724 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:55.710401 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:55.712492 (+ 2091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:55.712498 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:55.712501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:55.712824 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:55.713053 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:55.713053 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:55.713054 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:55.713179 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:55.713461 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:55.713467 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:55.713649 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 16:44:55.713737 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:44:55.713891 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":87,"threads_started":1}
I20260811 16:44:55.714641 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:55.703439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:36237 (local address 127.27.186.126:33821)
0811 16:44:55.704253 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:55.704255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:55.704264 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:44:55.704292 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:55.704293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:55.704306 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:55.704381 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:55.705240 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:55.706062 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:55.707556 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:55.707852 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:55.707936 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:55.710505 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:55.710507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:55.710507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:55.710515 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:55.712386 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:55.712923 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:55.712924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:55.712924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:55.712982 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:55.713256 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:55.713256 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:55.713257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:55.713384 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:55.714405 (+ 1021us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:55.714451 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 16:44:55.714539 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":77,"threads_started":1}
I20260811 16:44:55.716892 16794 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33821
I20260811 16:44:55.717023 16794 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:55.717257 16794 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:55.717850 16385 ts_manager.cc:194] Registered new tserver with Master: 683f768dac4544789a97a7ff0b4d5071 (127.27.186.65:46685)
I20260811 16:44:55.718757 16385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:36237
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:44:55.756183 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:43151/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33821
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:44:55 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466695, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 16:44:55.883764 16807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:55.884050 16807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:55.884091 16807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:55.885823 16807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:55.885875 16807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:55.885914 16807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:44:55.888073 16807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.27.186.84:43151/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:55.888459 16807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:55.888780 16807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:55.895104 16829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:55.895438 16821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:55.895661 16831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:55.896651 16807 server_base.cc:1034] running on GCE node
I20260811 16:44:55.896838 16807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:55.897083 16807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:55.898252 16807 hybrid_clock.cc:648] HybridClock initialized: now 1786466695898230 us; error 35 us; skew 500 ppm
Aug 11 16:44:55 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466695, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:55.901721 16807 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:44:55.902269 16807 webserver.cc:460] Webserver started at http://127.27.186.66:33115/ using document root <none> and password file <none>
I20260811 16:44:55.902534 16807 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:55.902598 16807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:44:55.902784 16807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:44:55 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466695, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:55.916430 16807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "cf51161c8ad446198b2ad6f519d1c8d1"
format_stamp: "Formatted at 2026-08-11 16:44:55 on dist-test-slave-gsp7"
server_key: "2d951039aaa59a4169d28ff110960ba8"
server_key_iv: "2770874d5b1fe8b1e17afc5cbb75a3f8"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:55.917006 16807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "cf51161c8ad446198b2ad6f519d1c8d1"
format_stamp: "Formatted at 2026-08-11 16:44:55 on dist-test-slave-gsp7"
server_key: "2d951039aaa59a4169d28ff110960ba8"
server_key_iv: "2770874d5b1fe8b1e17afc5cbb75a3f8"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:55.919616 16807 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 16:44:55.933626 16843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:55.933879 16807 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:55.933986 16807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "cf51161c8ad446198b2ad6f519d1c8d1"
format_stamp: "Formatted at 2026-08-11 16:44:55 on dist-test-slave-gsp7"
server_key: "2d951039aaa59a4169d28ff110960ba8"
server_key_iv: "2770874d5b1fe8b1e17afc5cbb75a3f8"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:55.934084 16807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:55.948727 16807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:55.951360 16807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:55.951542 16807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:55.951839 16807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:55.952239 16807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:55.952296 16807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:55.952332 16807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:55.952402 16807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:55.960296 16807 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:43855
I20260811 16:44:55.960419 17031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:43855 every 8 connection(s)
I20260811 16:44:55.960819 16807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:44:55 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466695, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:55.969645 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 16807
I20260811 16:44:55.969746 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:44:55.969954 28393 external_mini_cluster.cc:1428] Setting key 07bf3a13808fb06b43f8a5db3abc2182
I20260811 16:44:55.972841 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:55.962040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:49079 (local address 127.27.186.126:33821)
0811 16:44:55.962090 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:55.962092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:55.962105 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:44:55.962778 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:55.962779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:55.962797 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:55.962832 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:55.963834 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:55.964646 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:55.966180 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:55.966504 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:55.966552 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:55.969208 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:55.969210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:55.969210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:55.969219 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:55.971172 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:55.971703 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:55.971704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:55.971705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:55.971767 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:55.972071 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:55.972072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:55.972072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:55.972209 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:55.972252 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:55.972650 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 16:44:55.972745 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:44:55.973345 17034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:55.961724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33821 (local address 127.27.186.66:49079)
0811 16:44:55.961930 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:55.961981 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:55.962641 (+ 660us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:55.963019 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:55.963024 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:55.963289 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:55.963718 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:55.963725 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:55.964769 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:55.964770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:55.966069 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:55.966072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:55.966659 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:55.966660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:55.966801 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:55.967428 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:55.967438 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:55.969085 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:55.971283 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:55.971291 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:55.971294 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:55.971600 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:55.971847 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:55.971847 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:55.971848 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:55.971986 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:55.972303 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:55.972309 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:55.972488 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 16:44:55.972932 (+ 444us) client_negotiation.cc:240] Negotiation successful
0811 16:44:55.973095 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":101,"threads_started":1}
I20260811 16:44:55.974032 17032 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33821
I20260811 16:44:55.974128 17032 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:55.974313 17032 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:55.974766 16385 ts_manager.cc:194] Registered new tserver with Master: cf51161c8ad446198b2ad6f519d1c8d1 (127.27.186.66:43855)
I20260811 16:44:55.975304 16385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:49079
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:44:56.004135 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:43151/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33821
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:44:56.106185 17039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:56.106389 17039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:56.106413 17039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:56.107556 17039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:56.107597 17039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:56.107623 17039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:44:56.109189 17039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.27.186.84:43151/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:33821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:56.109421 17039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:56.109681 17039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:56.115170 17046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:56.115123 17047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:56.115507 17049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:56.116008 17039 server_base.cc:1034] running on GCE node
I20260811 16:44:56.116214 17039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:56.116462 17039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:56.117627 17039 hybrid_clock.cc:648] HybridClock initialized: now 1786466696117617 us; error 34 us; skew 500 ppm
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:56.122484 17039 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:44:56.123015 17039 webserver.cc:460] Webserver started at http://127.27.186.67:34263/ using document root <none> and password file <none>
I20260811 16:44:56.123296 17039 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:56.123353 17039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:44:56.123485 17039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:56.142831 17039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "9b4482b4a19e4bcca22686fc1e55c5d2"
format_stamp: "Formatted at 2026-08-11 16:44:56 on dist-test-slave-gsp7"
server_key: "fd899f5059b20c3b73c73a18214fc950"
server_key_iv: "cb629df224dd772774bf7a4f58b10149"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:56.143463 17039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "9b4482b4a19e4bcca22686fc1e55c5d2"
format_stamp: "Formatted at 2026-08-11 16:44:56 on dist-test-slave-gsp7"
server_key: "fd899f5059b20c3b73c73a18214fc950"
server_key_iv: "cb629df224dd772774bf7a4f58b10149"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:56.148804 17039 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260811 16:44:56.163218 17059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.163470 17039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:44:56.163601 17039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "9b4482b4a19e4bcca22686fc1e55c5d2"
format_stamp: "Formatted at 2026-08-11 16:44:56 on dist-test-slave-gsp7"
server_key: "fd899f5059b20c3b73c73a18214fc950"
server_key_iv: "cb629df224dd772774bf7a4f58b10149"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:56.163695 17039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:56.197626 17039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:56.201887 17039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:56.202145 17039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:56.202477 17039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:56.202978 17039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:56.203035 17039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.203069 17039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:56.203088 17039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.213936 17039 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:38167
I20260811 16:44:56.214874 17039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:44:56.215781 17253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:38167 every 8 connection(s)
I20260811 16:44:56.225106 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 17039
I20260811 16:44:56.225231 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:44:56.225430 28393 external_mini_cluster.cc:1428] Setting key d7a3b57a7398261159ed10320b65e37a
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:56.230068 16798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:56.216063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:35903 (local address 127.27.186.126:33821)
0811 16:44:56.216114 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:56.216117 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:56.219378 (+ 3261us) server_negotiation.cc:407] Connection header received
0811 16:44:56.219917 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:56.219919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:56.219933 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:56.220021 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:56.220763 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.221531 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.223085 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.223373 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.223423 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:56.226540 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:56.226542 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:56.226542 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:56.226550 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:56.228390 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:56.228880 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:56.228881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:56.228882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:56.228948 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:56.229269 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:56.229270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:56.229271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:56.229405 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:56.229450 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:56.229857 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 16:44:56.229948 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:44:56.230922 17258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:56.216061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33821 (local address 127.27.186.67:35903)
0811 16:44:56.219206 (+ 3145us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:56.219253 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:56.219801 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:56.220084 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:56.220087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:56.220339 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:56.220641 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:56.220648 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.221658 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.221658 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:56.222964 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:56.222967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.223541 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.223542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:56.223682 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:56.224367 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:56.224378 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:56.226422 (+ 2044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:56.228488 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:56.228495 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:56.228497 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:56.228792 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:56.229030 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:56.229031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:56.229031 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:56.229176 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:56.229528 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:56.229535 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:56.229694 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 16:44:56.230504 (+ 810us) client_negotiation.cc:240] Negotiation successful
0811 16:44:56.230673 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3097,"thread_start_us":3059,"threads_started":1}
I20260811 16:44:56.231647 17254 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33821
I20260811 16:44:56.231760 17254 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:56.231957 17254 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:56.232429 16385 ts_manager.cc:194] Registered new tserver with Master: 9b4482b4a19e4bcca22686fc1e55c5d2 (127.27.186.67:38167)
I20260811 16:44:56.232939 16385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:35903
I20260811 16:44:56.237190 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:44:56.237874 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 16541
I20260811 16:44:56.289633 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 16807
I20260811 16:44:56.303170 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 17039
I20260811 16:44:56.315876 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 16338
I20260811 16:44:56.327368 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:33821
--webserver_interface=127.27.186.126
--webserver_port=42325
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:33821
--ranger_config_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:43151/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.186.84:43151/kms with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:44:56.411448 17259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:56.411648 17259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:56.411669 17259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:56.412856 17259 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:44:56.412899 17259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:56.412914 17259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:56.412926 17259 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:44:56.412938 17259 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:44:56.414565 17259 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.186.84:43151/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:33821
--ranger_config_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:33821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=42325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:56.414808 17259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:56.415047 17259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:56.420035 17267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:56.420078 17274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:56.420100 17270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:56.420123 17259 server_base.cc:1034] running on GCE node
I20260811 16:44:56.420465 17259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:56.420778 17259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:56.421955 17259 hybrid_clock.cc:648] HybridClock initialized: now 1786466696421935 us; error 31 us; skew 500 ppm
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:56.424503 17259 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:44:56.424942 17259 webserver.cc:460] Webserver started at http://127.27.186.126:42325/ using document root <none> and password file <none>
I20260811 16:44:56.425122 17259 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:56.425170 17259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:56.501602 17259 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:56.502362 17289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.502573 17259 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:56.502682 17259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "5faaad2b004740a0812f0a4ab803dd7c"
format_stamp: "Formatted at 2026-08-11 16:44:54 on dist-test-slave-gsp7"
server_key: "a264a6afa30934a0b6624b416914fd7b"
server_key_iv: "e0285d96aab7a201eb515193131ba538"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:56.503077 17259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:56.512725 17259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:56.514401 17259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:56.514560 17259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:56.518743 17259 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:33821
I20260811 16:44:56.518792 17388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:33821 every 8 connection(s)
I20260811 16:44:56.519150 17259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:44:56.520318 17390 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:44:56.520988 17390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Bootstrap starting.
I20260811 16:44:56.524022 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 17259
I20260811 16:44:56.524315 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:43151/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:46685
--local_ip_for_outbound_sockets=127.27.186.65
--tserver_master_addrs=127.27.186.126:33821
--webserver_port=45815
--webserver_interface=127.27.186.65
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.186.84:43151/kms with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:44:56.529114 17390 log.cc:824] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:56.530821 17390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:44:56.531114 17390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Bootstrap complete.
I20260811 16:44:56.533607 17390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } }
I20260811 16:44:56.533876 17390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5faaad2b004740a0812f0a4ab803dd7c, State: Initialized, Role: FOLLOWER
I20260811 16:44:56.534078 17390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } }
I20260811 16:44:56.534171 17390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:44:56.534226 17390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:44:56.534274 17390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:44:56.535303 17390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } }
I20260811 16:44:56.535426 17390 leader_election.cc:302] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5faaad2b004740a0812f0a4ab803dd7c; no voters:
I20260811 16:44:56.535624 17390 leader_election.cc:288] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:44:56.535696 17394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:44:56.535820 17394 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [term 2 LEADER]: Becoming Leader. State: Replica: 5faaad2b004740a0812f0a4ab803dd7c, State: Running, Role: LEADER
I20260811 16:44:56.535905 17390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:44:56.535923 17394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } }
I20260811 16:44:56.536202 17395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5faaad2b004740a0812f0a4ab803dd7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } } }
I20260811 16:44:56.536298 17395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: This master's current role is: LEADER
I20260811 16:44:56.536439 17396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5faaad2b004740a0812f0a4ab803dd7c. Latest consensus state: current_term: 2 leader_uuid: "5faaad2b004740a0812f0a4ab803dd7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5faaad2b004740a0812f0a4ab803dd7c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33821 } } }
I20260811 16:44:56.536494 17396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c [sys.catalog]: This master's current role is: LEADER
I20260811 16:44:56.536583 17401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:44:56.537068 17401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:44:56.537192 17401 catalog_manager.cc:1259] Loaded cluster ID: f8a9249a25a0460b88f661750f82fd2c
I20260811 16:44:56.537228 17401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:44:56.537427 17390 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 16:44:56.541030 17401 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:44:56.541680 17401 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Loaded TSK: 0
I20260811 16:44:56.542007 17401 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:44:56.641747 17392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:56.642020 17392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:56.642059 17392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:56.643729 17392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:56.643783 17392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:56.643821 17392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:44:56.645907 17392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.186.84:43151/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:46685
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=45815
--tserver_master_addrs=127.27.186.126:33821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:56.646128 17392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:56.646365 17392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:56.653224 17458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:56.653308 17450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:56.653595 17451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:56.653925 17392 server_base.cc:1034] running on GCE node
I20260811 16:44:56.654152 17392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:56.654489 17392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:56.655675 17392 hybrid_clock.cc:648] HybridClock initialized: now 1786466696655646 us; error 44 us; skew 500 ppm
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:56.659087 17392 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:44:56.659650 17392 webserver.cc:460] Webserver started at http://127.27.186.65:45815/ using document root <none> and password file <none>
I20260811 16:44:56.659914 17392 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:56.660012 17392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:56.677333 17392 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260811 16:44:56.678458 17468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.678611 17392 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:44:56.678681 17392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "683f768dac4544789a97a7ff0b4d5071"
format_stamp: "Formatted at 2026-08-11 16:44:55 on dist-test-slave-gsp7"
server_key: "39ba4f8ab374231e1a03ee74bb70d3fd"
server_key_iv: "af540d2cb7bf5ea1804f4533ec1d5c04"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:56.679143 17392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:56.693593 17392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:56.695638 17392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:56.695791 17392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:56.696008 17392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:56.696472 17392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:56.696539 17392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.696580 17392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:56.696609 17392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.704026 17392 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:46685
I20260811 16:44:56.704177 17654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:46685 every 8 connection(s)
I20260811 16:44:56.704473 17392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:44:56.712457 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 17392
I20260811 16:44:56.712755 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:43151/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:43855
--local_ip_for_outbound_sockets=127.27.186.66
--tserver_master_addrs=127.27.186.126:33821
--webserver_port=33115
--webserver_interface=127.27.186.66
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.186.84:43151/kms with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:56.721211 17666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:56.705331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:40221 (local address 127.27.186.126:33821)
0811 16:44:56.705595 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:56.705604 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:56.705846 (+ 242us) server_negotiation.cc:407] Connection header received
0811 16:44:56.706624 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:56.706630 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:56.706677 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:56.706826 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:56.707510 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.708918 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.710514 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.711142 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.711265 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:56.716740 (+ 5475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:56.716746 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:56.716746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:56.716761 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:56.719028 (+ 2267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:56.719574 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:56.719578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:56.719578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:56.719692 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:56.720012 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:56.720013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:56.720013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:56.720334 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:56.720408 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:56.720813 (+ 405us) server_negotiation.cc:299] Negotiation successful
0811 16:44:56.720951 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":92,"threads_started":1}
I20260811 16:44:56.722152 17660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:56.705232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33821 (local address 127.27.186.65:40221)
0811 16:44:56.705682 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:56.705725 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:56.706398 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:56.706876 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:56.706880 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:56.707116 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:56.707392 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:56.707399 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.709076 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.709077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:56.710404 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:56.710407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.711274 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.711276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:56.711380 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:56.711899 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:56.711908 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:56.716587 (+ 4679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:56.719140 (+ 2553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:56.719148 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:56.719151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:56.719462 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:56.719774 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:56.719775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:56.719775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:56.719911 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:56.720449 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:56.720457 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:56.720615 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 16:44:56.721747 (+ 1132us) client_negotiation.cc:240] Negotiation successful
0811 16:44:56.721917 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":85,"threads_started":1}
I20260811 16:44:56.723177 17657 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33821
I20260811 16:44:56.723278 17657 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:56.723488 17657 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
W20260811 16:44:56.724390 17657 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:33821 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:44:56.724462 17657 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:56.724529 17657 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:56.724921 17657 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:56.725013 17657 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
W20260811 16:44:56.725358 17657 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:44:56.843336 17667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:56.843631 17667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:56.843669 17667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:56.845101 17667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:56.845180 17667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:56.845230 17667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:44:56.847128 17667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.186.84:43151/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:43855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=33115
--tserver_master_addrs=127.27.186.126:33821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:56.847396 17667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:56.847677 17667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:56.854779 17673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:56.855058 17678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:56.855038 17667 server_base.cc:1034] running on GCE node
W20260811 16:44:56.855317 17674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:56.855557 17667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:56.855860 17667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:56.857069 17667 hybrid_clock.cc:648] HybridClock initialized: now 1786466696857052 us; error 35 us; skew 500 ppm
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:56.860304 17667 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:44:56.860841 17667 webserver.cc:460] Webserver started at http://127.27.186.66:33115/ using document root <none> and password file <none>
I20260811 16:44:56.861121 17667 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:56.861222 17667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:56.875788 17667 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:56.876971 17693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.877146 17667 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:56.877244 17667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "cf51161c8ad446198b2ad6f519d1c8d1"
format_stamp: "Formatted at 2026-08-11 16:44:55 on dist-test-slave-gsp7"
server_key: "2d951039aaa59a4169d28ff110960ba8"
server_key_iv: "2770874d5b1fe8b1e17afc5cbb75a3f8"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:56.877769 17667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:56.899722 17667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:56.902139 17667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:56.902302 17667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:56.902565 17667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:56.902981 17667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:56.903038 17667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.903070 17667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:56.903095 17667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:56.911170 17667 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:43855
I20260811 16:44:56.911255 17891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:43855 every 8 connection(s)
I20260811 16:44:56.911692 17667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:44:56.914294 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 17667
I20260811 16:44:56.914594 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.27.186.84:43151/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:38167
--local_ip_for_outbound_sockets=127.27.186.67
--tserver_master_addrs=127.27.186.126:33821
--webserver_port=34263
--webserver_interface=127.27.186.67
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.27.186.84:43151/kms with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 16:44:56 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466696, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:56.923288 17666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:56.912488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:54283 (local address 127.27.186.126:33821)
0811 16:44:56.912783 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:56.912785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:56.912865 (+ 80us) server_negotiation.cc:407] Connection header received
0811 16:44:56.913581 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:56.913583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:56.913599 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:56.913668 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:56.914395 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.915168 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.916685 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.916997 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.917065 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:56.919691 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:56.919693 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:56.919693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:56.919701 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:56.921425 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:56.922071 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:56.922073 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:56.922073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:56.922142 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:56.922472 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:56.922473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:56.922474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:56.922622 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:56.922675 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:56.923087 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 16:44:56.923184 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264}
I20260811 16:44:56.923843 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:56.912520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33821 (local address 127.27.186.66:54283)
0811 16:44:56.912731 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:56.912781 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:56.913413 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:56.913742 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:56.913747 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:56.913977 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:56.914276 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:56.914283 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.915292 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.915293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:56.916588 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:56.916592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:56.917120 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:56.917122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:56.917261 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:56.917936 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:56.917947 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:56.919573 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:56.921574 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:56.921582 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:56.921584 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:56.921968 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:56.922227 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:56.922228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:56.922228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:56.922372 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:56.922731 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:56.922738 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:56.922909 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 16:44:56.923412 (+ 503us) client_negotiation.cc:240] Negotiation successful
0811 16:44:56.923597 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":98,"threads_started":1}
I20260811 16:44:56.924384 17899 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33821
I20260811 16:44:56.924501 17899 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:56.924726 17899 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
W20260811 16:44:56.925581 17899 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:33821 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:44:56.925668 17899 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:56.925746 17899 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:56.926293 17899 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:56.926381 17899 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
W20260811 16:44:56.926729 17899 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:44:57.023242 17904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:44:57.023479 17904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:44:57.023520 17904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:44:57.024926 17904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:44:57.024981 17904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:44:57.025023 17904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:44:57.026608 17904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.27.186.84:43151/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:38167
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=34263
--tserver_master_addrs=127.27.186.126:33821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:44:57.026882 17904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:44:57.027117 17904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:44:57.033285 17909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:57.033658 17904 server_base.cc:1034] running on GCE node
W20260811 16:44:57.034076 17910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:44:57.034399 17915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:44:57.034715 17904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:44:57.035013 17904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:44:57.036168 17904 hybrid_clock.cc:648] HybridClock initialized: now 1786466697036133 us; error 50 us; skew 500 ppm
Aug 11 16:44:57 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466697, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:57.039680 17904 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:44:57.040295 17904 webserver.cc:460] Webserver started at http://127.27.186.67:34263/ using document root <none> and password file <none>
I20260811 16:44:57.040606 17904 fs_manager.cc:359] Metadata directory not provided
I20260811 16:44:57.040740 17904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 16:44:57 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466697, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:57.057835 17904 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:44:57.058969 17924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:57.059144 17904 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:44:57.059237 17904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "9b4482b4a19e4bcca22686fc1e55c5d2"
format_stamp: "Formatted at 2026-08-11 16:44:56 on dist-test-slave-gsp7"
server_key: "fd899f5059b20c3b73c73a18214fc950"
server_key_iv: "cb629df224dd772774bf7a4f58b10149"
server_key_version: "kuduclusterkey@0"
I20260811 16:44:57.059760 17904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:44:57.076184 17904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:44:57.078675 17904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:44:57.078833 17904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:44:57.079046 17904 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:44:57.079408 17904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:44:57.079475 17904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:57.079520 17904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:44:57.079545 17904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:44:57.087330 17904 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:38167
I20260811 16:44:57.087447 18109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:38167 every 8 connection(s)
I20260811 16:44:57.087812 17904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:44:57 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466697, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:44:57.096264 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 17904
I20260811 16:44:57.097353 17666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:57.088543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:34003 (local address 127.27.186.126:33821)
0811 16:44:57.088591 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:57.088593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:57.088824 (+ 231us) server_negotiation.cc:407] Connection header received
0811 16:44:57.089352 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:57.089354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:57.089367 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:57.089426 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:57.090030 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:57.090553 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:57.091549 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:57.091816 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:57.091896 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:57.094065 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:57.094066 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:57.094067 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:57.094075 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:57.095525 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:57.095900 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:57.095901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:57.095902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:57.095970 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:57.096269 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:57.096270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:57.096271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:57.096413 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:57.096471 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:57.097119 (+ 648us) server_negotiation.cc:299] Negotiation successful
0811 16:44:57.097238 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":22}
I20260811 16:44:57.098170 18113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:57.088551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33821 (local address 127.27.186.67:34003)
0811 16:44:57.088703 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:57.088745 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:57.089241 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:57.089532 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:57.089536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:57.089718 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:44:57.089912 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:57.089918 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:57.090657 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:57.090658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:57.091445 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:57.091447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:57.091927 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:57.091928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:57.092045 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:57.092611 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:44:57.092622 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:44:57.093961 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:44:57.095593 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:57.095600 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:57.095603 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:57.095822 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:57.096040 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:44:57.096041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:44:57.096041 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:44:57.096178 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:44:57.096771 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:44:57.096779 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:44:57.096955 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 16:44:57.097769 (+ 814us) client_negotiation.cc:240] Negotiation successful
0811 16:44:57.097947 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260811 16:44:57.098817 18110 heartbeater.cc:347] Connected to a master server at 127.27.186.126:33821
I20260811 16:44:57.098915 18110 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:57.099104 18110 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
W20260811 16:44:57.099747 18110 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:33821 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 16:44:57.099831 18110 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:57.099906 18110 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:57.100212 18110 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:57.100287 18110 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
W20260811 16:44:57.100579 18110 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:44:57.105623 18114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:57.096650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53422 (local address 127.27.186.126:33821)
0811 16:44:57.096818 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:57.096819 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:57.096937 (+ 118us) server_negotiation.cc:407] Connection header received
0811 16:44:57.097063 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:57.097064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:57.097077 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:57.097123 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:57.097950 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:57.099376 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:57.101093 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:57.101303 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:57.101377 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:57.103030 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:57.103031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:57.103031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:57.103037 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:57.104429 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:57.104778 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:57.104779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:57.104780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:57.104836 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:57.105047 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:57.105048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:57.105048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:57.105148 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:57.105319 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:57.105355 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 16:44:57.105432 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":85,"threads_started":1}
Aug 11 16:44:57 dist-test-slave-gsp7 krb5kdc[15517](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786466697, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:44:57.725540 17657 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:57.725700 17657 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:57.726079 17318 ts_manager.cc:194] Registered new tserver with Master: 683f768dac4544789a97a7ff0b4d5071 (127.27.186.65:46685)
I20260811 16:44:57.727099 17318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:40221
I20260811 16:44:57.926908 17899 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:57.927117 17899 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:57.927397 17318 ts_manager.cc:194] Registered new tserver with Master: cf51161c8ad446198b2ad6f519d1c8d1 (127.27.186.66:43855)
I20260811 16:44:57.927857 17318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:54283
Aug 11 16:44:58 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466697, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:58.100790 18110 heartbeater.cc:464] Registering TS with master...
I20260811 16:44:58.100951 18110 heartbeater.cc:511] Master 127.27.186.126:33821 requested a full tablet report, sending...
I20260811 16:44:58.101334 17318 ts_manager.cc:194] Registered new tserver with Master: 9b4482b4a19e4bcca22686fc1e55c5d2 (127.27.186.67:38167)
I20260811 16:44:58.102164 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:44:58.103348 17318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:34003
I20260811 16:44:58.112481 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.104513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53428 (local address 127.27.186.126:33821)
0811 16:44:58.104842 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:58.104844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:58.105013 (+ 169us) server_negotiation.cc:407] Connection header received
0811 16:44:58.105037 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:58.105037 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:58.105050 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:58.105111 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:44:58.105985 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.106839 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.107845 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.108117 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.108204 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.109630 (+ 1426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:44:58.109631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:44:58.109632 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:44:58.109639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:44:58.111235 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:58.111586 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:58.111587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:58.111587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:58.111650 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:44:58.111842 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:44:58.111843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:44:58.111844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:44:58.111958 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:44:58.112060 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:58.112221 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 16:44:58.112306 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":68,"threads_started":1}
I20260811 16:44:58.114491 17318 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:44:58.116205 17318 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:44:58.130327 18157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.118997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:43855 (local address 127.0.0.1:59840)
0811 16:44:58.125600 (+ 6603us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:58.125655 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:58.125732 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:58.126089 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:58.126093 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:58.126095 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:58.126208 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.126211 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.127585 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.127586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.128926 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.128928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.129986 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.129987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.130085 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.130102 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 16:44:58.130172 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 16:44:58.130231 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6555,"thread_start_us":144,"threads_started":1}
I20260811 16:44:58.130690 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.119150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59840 (local address 127.27.186.66:43855)
0811 16:44:58.125917 (+ 6767us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:58.125921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:58.125930 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:44:58.125976 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:58.125978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:58.125992 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:58.126083 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:58.126330 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.127492 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.129024 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.129814 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.129885 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.129946 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:58.130568 (+ 622us) server_negotiation.cc:299] Negotiation successful
0811 16:44:58.130608 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6733,"thread_start_us":68,"threads_started":1}
I20260811 16:44:58.131310 18163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.119291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:46685 (local address 127.0.0.1:45544)
0811 16:44:58.126286 (+ 6995us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:58.126297 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:58.126368 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:58.126932 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:58.126933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:58.126935 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:58.127020 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.127021 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.128224 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.128225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.129265 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.129267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.131049 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.131050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.131122 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.131127 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:44:58.131181 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:44:58.131225 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6976,"thread_start_us":129,"threads_started":1}
I20260811 16:44:58.131599 18170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.119411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45544 (local address 127.27.186.65:46685)
0811 16:44:58.119586 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:58.119589 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:58.126435 (+ 6846us) server_negotiation.cc:407] Connection header received
0811 16:44:58.126478 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:58.126480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:58.126496 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:58.126569 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:58.127105 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.128127 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.129352 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.130952 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.131038 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.131094 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:58.131479 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 16:44:58.131519 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260811 16:44:58.131480 17776 tablet_service.cc:1467] Processing CreateTablet for tablet 346acc2719044a94872794bf27302870 (DEFAULT_TABLE table=test-table [id=3ab99f95c7744f6c822130b0cb8eacdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:44:58.131968 17776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 346acc2719044a94872794bf27302870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:44:58.132364 17544 tablet_service.cc:1467] Processing CreateTablet for tablet 346acc2719044a94872794bf27302870 (DEFAULT_TABLE table=test-table [id=3ab99f95c7744f6c822130b0cb8eacdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:44:58.132786 17544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 346acc2719044a94872794bf27302870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:44:58.135607 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.118997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38167 (local address 127.0.0.1:43254)
0811 16:44:58.125632 (+ 6635us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:58.125666 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:58.125723 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:58.131354 (+ 5631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:58.131355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:58.131536 (+ 181us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:58.131576 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.131578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.132808 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.132809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.134048 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.134052 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.135370 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.135371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.135435 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.135438 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:44:58.135497 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:44:58.135535 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6615,"mutex_wait_us":2,"thread_start_us":141,"threads_started":1}
I20260811 16:44:58.136099 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.119324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43254 (local address 127.27.186.67:38167)
0811 16:44:58.131185 (+ 11861us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:58.131190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:58.131200 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:44:58.131234 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:58.131235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:58.131252 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:58.131894 (+ 642us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:58.131999 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.132720 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.134153 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.135130 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.135274 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.135333 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:58.135927 (+ 594us) server_negotiation.cc:299] Negotiation successful
0811 16:44:58.135970 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11818,"thread_start_us":93,"threads_started":1}
I20260811 16:44:58.136875 17979 tablet_service.cc:1467] Processing CreateTablet for tablet 346acc2719044a94872794bf27302870 (DEFAULT_TABLE table=test-table [id=3ab99f95c7744f6c822130b0cb8eacdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:44:58.137207 17979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 346acc2719044a94872794bf27302870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:44:58.137276 18171 tablet_bootstrap.cc:492] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Bootstrap starting.
I20260811 16:44:58.138454 18171 tablet_bootstrap.cc:654] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Neither blocks nor log segments found. Creating new log.
I20260811 16:44:58.139314 18171 log.cc:824] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:58.140455 18171 tablet_bootstrap.cc:492] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: No bootstrap required, opened a new log
I20260811 16:44:58.140540 18171 ts_tablet_manager.cc:1397] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:44:58.144939 18171 raft_consensus.cc:348] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.145167 18171 raft_consensus.cc:374] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:44:58.145208 18171 raft_consensus.cc:729] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf51161c8ad446198b2ad6f519d1c8d1, State: Initialized, Role: FOLLOWER
I20260811 16:44:58.145534 18173 tablet_bootstrap.cc:492] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071: Bootstrap starting.
I20260811 16:44:58.145784 18171 consensus_queue.cc:260] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.146229 18171 ts_tablet_manager.cc:1428] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260811 16:44:58.146411 17899 heartbeater.cc:503] Master 127.27.186.126:33821 was elected leader, sending a full tablet report...
I20260811 16:44:58.146816 18173 tablet_bootstrap.cc:654] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071: Neither blocks nor log segments found. Creating new log.
I20260811 16:44:58.147249 18173 log.cc:824] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:58.147670 18179 tablet_bootstrap.cc:492] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Bootstrap starting.
I20260811 16:44:58.148650 18179 tablet_bootstrap.cc:654] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Neither blocks nor log segments found. Creating new log.
I20260811 16:44:58.148733 18173 tablet_bootstrap.cc:492] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071: No bootstrap required, opened a new log
I20260811 16:44:58.148792 18173 ts_tablet_manager.cc:1397] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:44:58.149415 18179 log.cc:824] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:44:58.150679 18179 tablet_bootstrap.cc:492] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: No bootstrap required, opened a new log
I20260811 16:44:58.150790 18179 ts_tablet_manager.cc:1397] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 16:44:58.152774 18173 raft_consensus.cc:348] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.152998 18173 raft_consensus.cc:374] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:44:58.153077 18173 raft_consensus.cc:729] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 683f768dac4544789a97a7ff0b4d5071, State: Initialized, Role: FOLLOWER
I20260811 16:44:58.153264 18173 consensus_queue.cc:260] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.153613 18173 ts_tablet_manager.cc:1428] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 16:44:58.153915 17657 heartbeater.cc:503] Master 127.27.186.126:33821 was elected leader, sending a full tablet report...
I20260811 16:44:58.155228 18179 raft_consensus.cc:348] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.155467 18179 raft_consensus.cc:374] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:44:58.155514 18179 raft_consensus.cc:729] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4482b4a19e4bcca22686fc1e55c5d2, State: Initialized, Role: FOLLOWER
I20260811 16:44:58.155659 18179 consensus_queue.cc:260] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.155984 18179 ts_tablet_manager.cc:1428] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260811 16:44:58.156162 18110 heartbeater.cc:503] Master 127.27.186.126:33821 was elected leader, sending a full tablet report...
W20260811 16:44:58.163218 17900 tablet.cc:2369] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:44:58.206079 17658 tablet.cc:2369] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:44:58.306816 18180 raft_consensus.cc:482] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:44:58.307001 18180 raft_consensus.cc:504] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.307472 18180 leader_election.cc:288] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4482b4a19e4bcca22686fc1e55c5d2 (127.27.186.67:38167), 683f768dac4544789a97a7ff0b4d5071 (127.27.186.65:46685)
I20260811 16:44:58.312618 18170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.308380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:59993 (local address 127.27.186.65:46685)
0811 16:44:58.308435 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:58.308437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:58.308610 (+ 173us) server_negotiation.cc:407] Connection header received
0811 16:44:58.308714 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:58.308716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:58.308726 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:58.308757 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:58.309048 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.309762 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.311455 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.312073 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.312131 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.312141 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:58.312480 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 16:44:58.312526 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:44:58.313135 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.308161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:46685 (local address 127.27.186.66:59993)
0811 16:44:58.308546 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:58.308556 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:58.308637 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:58.308823 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:58.308823 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:58.308825 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:58.308947 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.308949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.309867 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.309868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.311319 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.311323 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.312249 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.312251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.312326 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.312330 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:44:58.312973 (+ 643us) client_negotiation.cc:240] Negotiation successful
0811 16:44:58.313020 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":94,"threads_started":1}
I20260811 16:44:58.313441 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.307950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:38047 (local address 127.27.186.67:38167)
0811 16:44:58.307993 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:58.307995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:58.308005 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:44:58.308032 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:58.308033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:58.308042 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:58.308098 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:44:58.308307 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.309008 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.312480 (+ 3472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.313021 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.313068 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.313076 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:58.313296 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 16:44:58.313337 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:44:58.313697 18187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.307714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38167 (local address 127.27.186.66:38047)
0811 16:44:58.307895 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:58.307910 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:44:58.307970 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:44:58.308150 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:44:58.308151 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:44:58.308154 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:44:58.308237 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.308239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.311237 (+ 2998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.311238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.312332 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:44:58.312334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.313135 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.313136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:44:58.313202 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.313216 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:44:58.313587 (+ 371us) client_negotiation.cc:240] Negotiation successful
0811 16:44:58.313628 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":108,"threads_started":1}
I20260811 16:44:58.313707 17573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "346acc2719044a94872794bf27302870" candidate_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683f768dac4544789a97a7ff0b4d5071" is_pre_election: true
I20260811 16:44:58.313923 17573 raft_consensus.cc:2454] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf51161c8ad446198b2ad6f519d1c8d1 in term 0.
I20260811 16:44:58.314038 18005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "346acc2719044a94872794bf27302870" candidate_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" is_pre_election: true
I20260811 16:44:58.314191 18005 raft_consensus.cc:2454] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf51161c8ad446198b2ad6f519d1c8d1 in term 0.
I20260811 16:44:58.314244 17694 leader_election.cc:302] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 683f768dac4544789a97a7ff0b4d5071, cf51161c8ad446198b2ad6f519d1c8d1; no voters:
I20260811 16:44:58.314401 18180 raft_consensus.cc:2781] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:44:58.314461 18180 raft_consensus.cc:482] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:44:58.314489 18180 raft_consensus.cc:3037] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:44:58.315714 18180 raft_consensus.cc:504] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.315861 18180 leader_election.cc:288] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [CANDIDATE]: Term 1 election: Requested vote from peers 9b4482b4a19e4bcca22686fc1e55c5d2 (127.27.186.67:38167), 683f768dac4544789a97a7ff0b4d5071 (127.27.186.65:46685)
I20260811 16:44:58.316169 18005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "346acc2719044a94872794bf27302870" candidate_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2"
I20260811 16:44:58.316262 18005 raft_consensus.cc:3037] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:44:58.317643 18005 raft_consensus.cc:2454] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf51161c8ad446198b2ad6f519d1c8d1 in term 1.
I20260811 16:44:58.317847 17696 leader_election.cc:302] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b4482b4a19e4bcca22686fc1e55c5d2, cf51161c8ad446198b2ad6f519d1c8d1; no voters:
I20260811 16:44:58.317970 17573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "346acc2719044a94872794bf27302870" candidate_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "683f768dac4544789a97a7ff0b4d5071"
I20260811 16:44:58.318059 17573 raft_consensus.cc:3037] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:44:58.319339 17573 raft_consensus.cc:2454] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf51161c8ad446198b2ad6f519d1c8d1 in term 1.
I20260811 16:44:58.319558 18180 raft_consensus.cc:2781] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:44:58.319727 18180 raft_consensus.cc:686] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 1 LEADER]: Becoming Leader. State: Replica: cf51161c8ad446198b2ad6f519d1c8d1, State: Running, Role: LEADER
I20260811 16:44:58.319835 18180 consensus_queue.cc:237] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } }
I20260811 16:44:58.320708 17318 catalog_manager.cc:5495] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf51161c8ad446198b2ad6f519d1c8d1 (127.27.186.66). New cstate: current_term: 1 leader_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf51161c8ad446198b2ad6f519d1c8d1" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 43855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 } health_report { overall_health: UNKNOWN } } }
W20260811 16:44:58.339088 18111 tablet.cc:2369] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 16:44:58 dist-test-slave-gsp7 krb5kdc[15517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466697, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for HTTP/127.27.186.84@KRBTEST.COM
I20260811 16:44:58.361774 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.358412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59854 (local address 127.27.186.66:43855)
0811 16:44:58.358476 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:44:58.358478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:44:58.358490 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:44:58.358539 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:44:58.358540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:44:58.358564 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:44:58.358648 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:44:58.358811 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.359525 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.360587 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:44:58.360893 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:44:58.360958 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:44:58.361226 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:44:58.361382 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:44:58.361469 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:44:58.361669 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 16:44:58.361692 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:44:58.364435 18005 raft_consensus.cc:1261] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 1 FOLLOWER]: Refusing update from remote peer cf51161c8ad446198b2ad6f519d1c8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:44:58.364451 17573 raft_consensus.cc:1261] T 346acc2719044a94872794bf27302870 P 683f768dac4544789a97a7ff0b4d5071 [term 1 FOLLOWER]: Refusing update from remote peer cf51161c8ad446198b2ad6f519d1c8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:44:58.364764 18180 consensus_queue.cc:1035] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "683f768dac4544789a97a7ff0b4d5071" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:44:58.364975 18191 consensus_queue.cc:1035] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4482b4a19e4bcca22686fc1e55c5d2" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:44:58.368526 18197 mvcc.cc:205] Tried to move back new op lower bound from 7317367596496744448 to 7317367596318601216. Current Snapshot: MvccSnapshot[applied={T|T < 7317367596496744448}]
I20260811 16:44:58.369132 18200 mvcc.cc:205] Tried to move back new op lower bound from 7317367596496744448 to 7317367596318601216. Current Snapshot: MvccSnapshot[applied={T|T < 7317367596496744448}]
I20260811 16:44:58.371006 18201 mvcc.cc:205] Tried to move back new op lower bound from 7317367596496744448 to 7317367596318601216. Current Snapshot: MvccSnapshot[applied={T|T < 7317367596496744448}]
I20260811 16:44:58.373783 17319 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:44:58.373885 17319 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53428:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:44:58.374699 17319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5faaad2b004740a0812f0a4ab803dd7c: Sending DeleteTablet for 3 replicas of tablet 346acc2719044a94872794bf27302870
I20260811 16:44:58.375140 17979 tablet_service.cc:1514] Processing DeleteTablet for tablet 346acc2719044a94872794bf27302870 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:44:58 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:43254
I20260811 16:44:58.375950 17776 tablet_service.cc:1514] Processing DeleteTablet for tablet 346acc2719044a94872794bf27302870 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:44:58 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:59840
I20260811 16:44:58.376276 17544 tablet_service.cc:1514] Processing DeleteTablet for tablet 346acc2719044a94872794bf27302870 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:44:58 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:45544
I20260811 16:44:58.376874 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 17392
I20260811 16:44:58.392560 18218 tablet_replica.cc:330] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: stopping tablet replica
I20260811 16:44:58.392732 18218 raft_consensus.cc:2229] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:44:58.392871 18218 raft_consensus.cc:2258] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:44:58.400147 18218 ts_tablet_manager.cc:1905] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:44:58.403013 18216 tablet_replica.cc:330] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: stopping tablet replica
I20260811 16:44:58.403175 18216 raft_consensus.cc:2229] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:44:58.403343 18216 raft_consensus.cc:2258] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:44:58.406080 18216 ts_tablet_manager.cc:1905] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:44:58.409235 18218 ts_tablet_manager.cc:1918] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:44:58.409343 18218 log.cc:1196] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/346acc2719044a94872794bf27302870
I20260811 16:44:58.410926 18216 ts_tablet_manager.cc:1918] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:44:58.411018 18216 log.cc:1196] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/346acc2719044a94872794bf27302870
I20260811 16:44:58.411337 18216 ts_tablet_manager.cc:1939] T 346acc2719044a94872794bf27302870 P 9b4482b4a19e4bcca22686fc1e55c5d2: Deleting consensus metadata
I20260811 16:44:58.411895 17292 catalog_manager.cc:4841] TS 9b4482b4a19e4bcca22686fc1e55c5d2 (127.27.186.67:38167): tablet 346acc2719044a94872794bf27302870 (table test-table [id=3ab99f95c7744f6c822130b0cb8eacdb]) successfully deleted
I20260811 16:44:58.412252 18218 ts_tablet_manager.cc:1939] T 346acc2719044a94872794bf27302870 P cf51161c8ad446198b2ad6f519d1c8d1: Deleting consensus metadata
I20260811 16:44:58.412716 17290 catalog_manager.cc:4841] TS cf51161c8ad446198b2ad6f519d1c8d1 (127.27.186.66:43855): tablet 346acc2719044a94872794bf27302870 (table test-table [id=3ab99f95c7744f6c822130b0cb8eacdb]) successfully deleted
W20260811 16:44:58.414742 17290 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:46685 (error 108)
I20260811 16:44:58.425225 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 17667
I20260811 16:44:58.432008 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:44:58.431848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:46685 (local address 127.0.0.1:45556)
0811 16:44:58.431902 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:44:58.431964 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:46685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 16:44:58.432183 17290 catalog_manager.cc:4584] TS 683f768dac4544789a97a7ff0b4d5071 (127.27.186.65:46685): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 346acc2719044a94872794bf27302870: Network error: Client connection negotiation failed: client connection to 127.27.186.65:46685: connect: Connection refused (error 111)
I20260811 16:44:58.436442 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 17904
I20260811 16:44:58.456849 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 17259
I20260811 16:44:58.477253 28393 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 16:44:58.822043 28393 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 16:44:58.822135 28393 mini_ranger.cc:66] Stopping Ranger...
I20260811 16:44:59.176999 28393 mini_ranger.cc:68] Stopped Ranger
2026-08-11 16:44:59.177 UTC [15575] LOG: received smart shutdown request
2026-08-11 16:44:59.182 UTC [15575] LOG: background worker "logical replication launcher" (PID 15597) exited with exit code 1
2026-08-11 16:44:59.182 UTC [15585] LOG: shutting down
2026-08-11 16:44:59.362 UTC [15575] LOG: database system is shut down
2026-08-11T16:44:59Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50730 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:44:59 dist-test-slave-gsp7 krb5kdc[18237](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:44:59 dist-test-slave-gsp7 krb5kdc[18237](info): set up 2 sockets
Aug 11 16:44:59 dist-test-slave-gsp7 krb5kdc[18237](info): commencing operation
krb5kdc: starting...
W20260811 16:45:00.755479 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:45:00 dist-test-slave-gsp7 krb5kdc[18237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:45:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:45:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:45:00.883916 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:33889
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:40709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:33889,127.27.186.125:36973,127.27.186.124:35917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:00.965617 18267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:00.965863 18267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:00.965903 18267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:00.967046 18267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:00.967113 18267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:00.967136 18267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:00.967159 18267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:00.967185 18267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:00.968655 18267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:40709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:33889,127.27.186.125:36973,127.27.186.124:35917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:33889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:00.968927 18267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:00.969151 18267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:00.974047 18284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:00.974050 18274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:00.974105 18275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:00.974220 18267 server_base.cc:1034] running on GCE node
I20260811 16:45:00.974547 18267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:00.974845 18267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:00.976015 18267 hybrid_clock.cc:648] HybridClock initialized: now 1786466700976004 us; error 45 us; skew 500 ppm
Aug 11 16:45:00 dist-test-slave-gsp7 krb5kdc[18237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466700, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:00.978595 18267 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:45:00.979085 18267 webserver.cc:460] Webserver started at http://127.27.186.126:44343/ using document root <none> and password file <none>
I20260811 16:45:00.979326 18267 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:00.979393 18267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:00.979544 18267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:00.980612 18267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "a53c9233616947e2bd3ce02b35948b30"
format_stamp: "Formatted at 2026-08-11 16:45:00 on dist-test-slave-gsp7"
server_key: "c389ffb6d6e5b59e894945f870ed988b"
server_key_iv: "030deebf76ff50f0958bbd1159d3cc6b"
server_key_version: "encryptionkey@0"
I20260811 16:45:00.980986 18267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "a53c9233616947e2bd3ce02b35948b30"
format_stamp: "Formatted at 2026-08-11 16:45:00 on dist-test-slave-gsp7"
server_key: "c389ffb6d6e5b59e894945f870ed988b"
server_key_iv: "030deebf76ff50f0958bbd1159d3cc6b"
server_key_version: "encryptionkey@0"
I20260811 16:45:00.982390 18267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:45:00.983129 18295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:00.983292 18267 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:45:00.983400 18267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "a53c9233616947e2bd3ce02b35948b30"
format_stamp: "Formatted at 2026-08-11 16:45:00 on dist-test-slave-gsp7"
server_key: "c389ffb6d6e5b59e894945f870ed988b"
server_key_iv: "030deebf76ff50f0958bbd1159d3cc6b"
server_key_version: "encryptionkey@0"
I20260811 16:45:00.983490 18267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:00.991041 18267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:00.992957 18267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:00.993113 18267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:00.997308 18267 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:33889
I20260811 16:45:00.997341 18391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:33889 every 8 connection(s)
I20260811 16:45:00.997748 18267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:45:00.998596 18394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:00.999162 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 18267
I20260811 16:45:00.999280 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:45:00.999476 28393 external_mini_cluster.cc:1428] Setting key e9a3d59cfccf9fb4a3636fd25ac7b2a1
I20260811 16:45:01.000996 18394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466700, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.186.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.125@KRBTEST.COM" created.
I20260811 16:45:01.012465 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.001946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33889 (local address 127.0.0.1:50004)
0811 16:45:01.002143 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.002185 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.002766 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.003073 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.003076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.003474 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.003697 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.003703 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.004740 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.004742 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.006008 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.006012 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.006545 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.006547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.006634 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.007170 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.007181 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.008964 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.010836 (+ 1872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.010843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.010845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.011043 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.011349 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.011350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.011351 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.011442 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.011837 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.011843 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.011910 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.012038 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.012277 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":94,"thread_start_us":114,"threads_started":1}
I20260811 16:45:01.012462 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.002187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50004 (local address 127.27.186.126:33889)
0811 16:45:01.002370 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.002376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.002425 (+ 49us) server_negotiation.cc:407] Connection header received
0811 16:45:01.002928 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.002930 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.002948 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.003042 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.003817 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.004640 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.006120 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.006447 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.006537 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.009083 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.009091 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.009091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.009104 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.010730 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.011141 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.011144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.011145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.011287 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.011516 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.011517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.011517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.011746 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.011852 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.012077 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.012213 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":76,"threads_started":1}
I20260811 16:45:01.013464 18394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:45:01.013839 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.013734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53810)
0811 16:45:01.013778 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.013821 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 16:45:01.013973 18296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
I20260811 16:45:01.014396 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.014299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53820)
0811 16:45:01.014348 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.014372 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 16:45:01.014500 18394 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:36973: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab.
Entry for principal kudu/127.27.186.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab.
I20260811 16:45:01.028541 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.125:36973
--webserver_interface=127.27.186.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab
--principal=kudu/127.27.186.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:40709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:33889,127.27.186.125:36973,127.27.186.124:35917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:01.063745 18394 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } attempt: 1
I20260811 16:45:01.064298 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.064139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53822)
0811 16:45:01.064206 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.064259 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 16:45:01.064671 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.064583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53826)
0811 16:45:01.064624 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.064652 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 16:45:01.064782 18394 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:36973: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
W20260811 16:45:01.113593 18405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:01.113802 18405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:01.113826 18405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:01.114985 18405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:01.115028 18405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:01.115043 18405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:01.115056 18405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:01.115103 18405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:01.116587 18405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:40709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:33889,127.27.186.125:36973,127.27.186.124:35917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab
--principal=kudu/127.27.186.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.125:36973
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.186.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:01.116849 18405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:01.117086 18405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:01.122025 18414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:01.122071 18419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:01.122082 18416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:01.122236 18405 server_base.cc:1034] running on GCE node
I20260811 16:45:01.122471 18405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:01.122802 18405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:01.123943 18405 hybrid_clock.cc:648] HybridClock initialized: now 1786466701123925 us; error 29 us; skew 500 ppm
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466701, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:01.126626 18405 init.cc:377] Logged in from keytab as kudu/127.27.186.125@KRBTEST.COM (short username kudu)
I20260811 16:45:01.127117 18405 webserver.cc:460] Webserver started at http://127.27.186.125:42841/ using document root <none> and password file <none>
I20260811 16:45:01.127364 18405 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:01.127413 18405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:01.127574 18405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:01.128693 18405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/data/instance:
uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165"
format_stamp: "Formatted at 2026-08-11 16:45:01 on dist-test-slave-gsp7"
server_key: "8d550c11e92a4814eea590f13240e285"
server_key_iv: "59b7410773c6e8c6ab7975e0808030b2"
server_key_version: "encryptionkey@0"
I20260811 16:45:01.129072 18405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/wal/instance:
uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165"
format_stamp: "Formatted at 2026-08-11 16:45:01 on dist-test-slave-gsp7"
server_key: "8d550c11e92a4814eea590f13240e285"
server_key_iv: "59b7410773c6e8c6ab7975e0808030b2"
server_key_version: "encryptionkey@0"
I20260811 16:45:01.130573 18405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:45:01.131385 18432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:01.131610 18405 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:45:01.131713 18405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/wal
uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165"
format_stamp: "Formatted at 2026-08-11 16:45:01 on dist-test-slave-gsp7"
server_key: "8d550c11e92a4814eea590f13240e285"
server_key_iv: "59b7410773c6e8c6ab7975e0808030b2"
server_key_version: "encryptionkey@0"
I20260811 16:45:01.131786 18405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:01.132964 18394 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } attempt: 2
I20260811 16:45:01.133427 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.133275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53842)
0811 16:45:01.133343 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.133389 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 16:45:01.133852 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.133735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53852)
0811 16:45:01.133786 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.133819 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 16:45:01.133966 18394 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:36973: Network error: Client connection negotiation failed: client connection to 127.27.186.125:36973: connect: Connection refused (error 111)
I20260811 16:45:01.158851 18405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:01.161375 18405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:01.161592 18405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:01.165652 18405 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.125:36973
I20260811 16:45:01.165697 18525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.125:36973 every 8 connection(s)
I20260811 16:45:01.166088 18405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
I20260811 16:45:01.166947 18526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:01.168519 18526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466701, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:01.174420 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 18405
I20260811 16:45:01.174547 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-1/wal/instance
I20260811 16:45:01.174741 28393 external_mini_cluster.cc:1428] Setting key a77f263bc300623ec48fbadb186ac8af
I20260811 16:45:01.177702 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.169227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50006 (local address 127.27.186.126:33889)
0811 16:45:01.169304 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.169307 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.169518 (+ 211us) server_negotiation.cc:407] Connection header received
0811 16:45:01.169992 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.169993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.170004 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.170069 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.170693 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.171181 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.172109 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.172308 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.172362 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.174599 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.174601 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.174601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.174608 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.176068 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.176605 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.176607 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.176607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.176694 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.176976 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.176977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.176977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.177137 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.177209 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.177455 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.177586 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:45:01.177740 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.169179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33889 (local address 127.0.0.1:50006)
0811 16:45:01.169362 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.169398 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.169903 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.170131 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.170134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.170391 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.170619 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.170624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.171260 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.171261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.172036 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.172038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.172379 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.172380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.172496 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.172928 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.172936 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.174481 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.176143 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.176152 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.176154 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.176481 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.176792 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.176793 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.176793 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.176907 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.177212 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.177217 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.177328 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.177414 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.177586 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":93,"threads_started":1}
I20260811 16:45:01.178323 18526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466701, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.186.124@KRBTEST.COM; defaulting to no policy
I20260811 16:45:01.185817 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.178639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53862)
0811 16:45:01.178696 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.178706 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.178745 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.178998 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.178998 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.179141 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.179182 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.179184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.180119 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.180120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.180610 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.180612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.181067 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.181068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.181133 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.181581 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.181585 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.182990 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.184830 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.184831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.184831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.185008 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.185191 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.185191 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.185191 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.185241 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.185457 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.185458 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.185551 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.185606 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.185680 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 16:45:01.185842 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.178705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53862 (local address 127.27.186.125:36973)
0811 16:45:01.178864 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.178868 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.178884 (+ 16us) server_negotiation.cc:407] Connection header received
0811 16:45:01.178902 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.178903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.178913 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.178998 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.179263 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.180029 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.180701 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.180983 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.181068 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.183079 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.183087 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.183087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.183093 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.184700 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.185076 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.185078 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.185079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.185132 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.185279 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.185279 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.185280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.185405 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.185464 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.185632 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.185739 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260811 16:45:01.186540 18526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.124@KRBTEST.COM" created.
I20260811 16:45:01.186877 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.186777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41286)
0811 16:45:01.186825 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.186860 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 16:45:01.187005 18434 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
I20260811 16:45:01.187438 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.187360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41300)
0811 16:45:01.187391 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.187414 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 16:45:01.187532 18526 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:35917: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab.
Entry for principal kudu/127.27.186.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab.
I20260811 16:45:01.202524 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.124:35917
--webserver_interface=127.27.186.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab
--principal=kudu/127.27.186.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:40709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:33889,127.27.186.125:36973,127.27.186.124:35917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:01.225147 18394 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } attempt: 3
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466700, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:45:01.236730 18526 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } attempt: 1
I20260811 16:45:01.237383 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.237013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41312)
0811 16:45:01.237313 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.237346 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278}
I20260811 16:45:01.237782 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.237606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41318)
0811 16:45:01.237734 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.237757 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
W20260811 16:45:01.237848 18526 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:35917: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
I20260811 16:45:01.238893 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.225580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53864)
0811 16:45:01.225639 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.225655 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.225711 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.225943 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.225944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.226135 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.226203 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.226205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.227003 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.227004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.227520 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.227522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.227897 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.227898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.227972 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.232835 (+ 4863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.232840 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.234413 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.236565 (+ 2152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.236566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.236567 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.237215 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.237972 (+ 757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.237973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.237973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.238065 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.238387 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.238388 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.238519 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.238623 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.238776 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 16:45:01.238929 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.225754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53864 (local address 127.27.186.125:36973)
0811 16:45:01.225822 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.225824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.225832 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:45:01.225856 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.225857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.225867 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.225924 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.226284 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.226922 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.227602 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.227816 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.227887 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.234530 (+ 6643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.234533 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.234533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.234543 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.236461 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.237301 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.237303 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.237303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.237413 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.238162 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.238163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.238163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.238319 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.238389 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.238663 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.238815 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 16:45:01.241529 18394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:45:01.241942 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.241773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41322)
0811 16:45:01.241861 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.241899 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 16:45:01.242345 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.242253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41324)
0811 16:45:01.242292 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.242321 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 16:45:01.242518 18394 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:35917: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
I20260811 16:45:01.273663 18394 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } attempt: 1
I20260811 16:45:01.274230 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.274050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41326)
0811 16:45:01.274130 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.274191 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 16:45:01.274546 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.274452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41332)
0811 16:45:01.274482 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.274508 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 16:45:01.274624 18394 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:35917: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
W20260811 16:45:01.302529 18535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:01.302742 18535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:01.302764 18535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:01.303839 18535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:01.303872 18535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:01.303886 18535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:01.303898 18535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:01.303910 18535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:01.305397 18535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:40709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:33889,127.27.186.125:36973,127.27.186.124:35917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab
--principal=kudu/127.27.186.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.124:35917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.186.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:01.305672 18535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:01.305857 18535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:45:01.305989 18526 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } attempt: 2
I20260811 16:45:01.306488 18537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.306291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41342)
0811 16:45:01.306384 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.306442 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 16:45:01.306838 18537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.306741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41358)
0811 16:45:01.306784 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.306811 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 16:45:01.306924 18526 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:35917: Network error: Client connection negotiation failed: client connection to 127.27.186.124:35917: connect: Connection refused (error 111)
W20260811 16:45:01.310772 18547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:01.310817 18550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:01.310992 18535 server_base.cc:1034] running on GCE node
W20260811 16:45:01.311106 18546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:01.311343 18535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:01.311645 18535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:01.312804 18535 hybrid_clock.cc:648] HybridClock initialized: now 1786466701312793 us; error 30 us; skew 500 ppm
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466701, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:01.315361 18535 init.cc:377] Logged in from keytab as kudu/127.27.186.124@KRBTEST.COM (short username kudu)
I20260811 16:45:01.315819 18535 webserver.cc:460] Webserver started at http://127.27.186.124:46447/ using document root <none> and password file <none>
I20260811 16:45:01.316020 18535 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:01.316062 18535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:01.316152 18535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:01.317170 18535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/data/instance:
uuid: "ed18328745e44e8db560abbb3ea6dbdf"
format_stamp: "Formatted at 2026-08-11 16:45:01 on dist-test-slave-gsp7"
server_key: "e49bf095ec11c2a51031ecef3a6cb449"
server_key_iv: "852c2441a63a464064916e856f825f7a"
server_key_version: "encryptionkey@0"
I20260811 16:45:01.317540 18535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/wal/instance:
uuid: "ed18328745e44e8db560abbb3ea6dbdf"
format_stamp: "Formatted at 2026-08-11 16:45:01 on dist-test-slave-gsp7"
server_key: "e49bf095ec11c2a51031ecef3a6cb449"
server_key_iv: "852c2441a63a464064916e856f825f7a"
server_key_version: "encryptionkey@0"
I20260811 16:45:01.319000 18535 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:45:01.319692 18558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:01.319888 18535 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:45:01.319981 18535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/wal
uuid: "ed18328745e44e8db560abbb3ea6dbdf"
format_stamp: "Formatted at 2026-08-11 16:45:01 on dist-test-slave-gsp7"
server_key: "e49bf095ec11c2a51031ecef3a6cb449"
server_key_iv: "852c2441a63a464064916e856f825f7a"
server_key_version: "encryptionkey@0"
I20260811 16:45:01.320058 18535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:01.339941 18535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:01.341998 18535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:01.342116 18535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:01.346130 18535 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.124:35917
I20260811 16:45:01.346182 18648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.124:35917 every 8 connection(s)
I20260811 16:45:01.346544 18535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
I20260811 16:45:01.347456 18650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:01.348383 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 18535
I20260811 16:45:01.348465 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786466533930122-28393-0/minicluster-data/master-2/wal/instance
I20260811 16:45:01.348664 28393 external_mini_cluster.cc:1428] Setting key ceb1dabfc63be88f3a1bc6c510469e63
I20260811 16:45:01.349746 18394 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } attempt: 2
I20260811 16:45:01.349417 18650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466700, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466701, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
I20260811 16:45:01.359221 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.350026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41382)
0811 16:45:01.350089 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.350099 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.350161 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.350817 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.350818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.351014 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.351073 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.351075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.352618 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.352619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.353259 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.353262 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.353910 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.353911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.353972 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.354292 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.354296 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.355754 (+ 1458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.357729 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.357730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.357731 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.357965 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.358260 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.358261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.358262 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.358334 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.358838 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.358840 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.358888 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.359015 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.359115 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 16:45:01.359751 18659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.350090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41382 (local address 127.27.186.124:35917)
0811 16:45:01.350297 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.350300 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.350308 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:45:01.350327 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.350328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.350337 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.351159 (+ 822us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.351199 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.352534 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.353349 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.353835 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.353906 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.355837 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.355844 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.355844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.355850 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.357636 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.358048 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.358052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.358052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.358172 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.358418 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.358419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.358419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.358748 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.358846 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.359101 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.359222 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":186,"thread_start_us":94,"threads_started":1}
I20260811 16:45:01.359967 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.350705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50020 (local address 127.27.186.126:33889)
0811 16:45:01.350749 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.350751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.350917 (+ 166us) server_negotiation.cc:407] Connection header received
0811 16:45:01.350962 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.350963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.350973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.351036 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.351553 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.352030 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.353018 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.353327 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.353403 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.356971 (+ 3568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.356972 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.356973 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.356980 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.358638 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.359008 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.359009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.359009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.359071 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.359301 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.359302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.359302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.359465 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.359510 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.359798 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.359876 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:45:01.360342 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.350615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:33889 (local address 127.0.0.1:50020)
0811 16:45:01.350786 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.350833 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.350912 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.351071 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.351074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.351353 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.351460 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.351464 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.352112 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.352113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.352924 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.352926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.353497 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.353498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.353627 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.354443 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.354452 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.356883 (+ 2431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.358718 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.358725 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.358727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.358915 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.359148 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.359148 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.359149 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.359217 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.359572 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.359578 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.359638 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.360054 (+ 416us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.360208 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
I20260811 16:45:01.360843 18650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:45:01.362360 18394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30: Bootstrap starting.
I20260811 16:45:01.362625 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.349208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41374 (local address 127.27.186.124:35917)
0811 16:45:01.349408 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.349418 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.349453 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:45:01.350154 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.350165 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.350231 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.350396 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.351199 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.352529 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.353447 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.353835 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.353906 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.357746 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.357748 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.357748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.357755 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.360350 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.361553 (+ 1203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.361554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.361555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.361626 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.361875 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.361876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.361876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.361999 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.362120 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.362331 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.362477 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":255,"server-negotiator.queue_time_us":148,"thread_start_us":87,"threads_started":1}
I20260811 16:45:01.363077 18394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:01.363454 18394 log.cc:824] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:01.364670 18394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30: No bootstrap required, opened a new log
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466701, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:45:01.366704 18394 raft_consensus.cc:348] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.366899 18394 raft_consensus.cc:374] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:01.366954 18394 raft_consensus.cc:729] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a53c9233616947e2bd3ce02b35948b30, State: Initialized, Role: FOLLOWER
I20260811 16:45:01.367085 18394 consensus_queue.cc:260] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.367453 18394 sys_catalog.cc:564] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:01.367403 18662 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.367635 18662 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:45:01.368227 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.361091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:36973 (local address 127.0.0.1:53874)
0811 16:45:01.361138 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.361148 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.361187 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.361342 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.361343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.361515 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.361550 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.361552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.362159 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.362160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.363038 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.363041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.363510 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.363511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.363601 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.363987 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.363992 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.365250 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.367062 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.367063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.367063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.367280 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.367519 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.367520 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.367521 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.367588 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.367895 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.367896 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.367928 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.368039 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.368135 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 16:45:01.368232 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.361171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53874 (local address 127.27.186.125:36973)
0811 16:45:01.361229 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.361231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.361239 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:45:01.361263 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.361264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.361273 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.361339 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.361624 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.362083 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.363133 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.363433 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.363515 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.365339 (+ 1824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.365340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.365341 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.365348 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.366981 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.367362 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.367363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.367364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.367429 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.367665 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.367666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.367666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.367798 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.367846 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.368072 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.368146 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
W20260811 16:45:01.369467 18681 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 16:45:01.369562 18650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } has no permanent_uuid. Determining permanent_uuid...
W20260811 16:45:01.369625 18681 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466701, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
I20260811 16:45:01.373711 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.363996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50034 (local address 127.27.186.126:33889)
0811 16:45:01.364050 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.364051 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.364057 (+ 6us) server_negotiation.cc:407] Connection header received
0811 16:45:01.364073 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.364073 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.364080 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.364140 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.364733 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.365376 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.366397 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.366703 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.366793 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.370078 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.370079 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.370080 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.370087 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.372312 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.372725 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.372726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.372727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.372777 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.372991 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.372992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.372992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.373124 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.373257 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.373549 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.373629 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:45:01.370601 18267 master_runner.cc:186] Error getting master registration for 127.27.186.125:36973: OK, instance_id { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" instance_seqno: 1786466701164501 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:45:01.374147 18267 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:45:01.376914 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.369793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41392)
0811 16:45:01.369832 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.369843 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.369885 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.370047 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.370048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.370191 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.370227 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.370228 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.371086 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.371087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.371558 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.371560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.372063 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.372064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.372119 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.372491 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.372496 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.373868 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.375764 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.375765 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.375766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.375985 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.376181 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.376182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.376182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.376248 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.376562 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.376563 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.376609 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.376684 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.376795 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 16:45:01.376998 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.369866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41392 (local address 127.27.186.124:35917)
0811 16:45:01.369901 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.369903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.369911 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:45:01.369932 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.369933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.369942 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.369996 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.370306 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.371006 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.371646 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.371954 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.372019 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.374040 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.374041 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.374041 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.374047 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.375682 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.376053 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.376053 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.376054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.376111 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.376317 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.376318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.376318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.376487 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.376553 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.376723 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.376862 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":18}
I20260811 16:45:01.378647 18650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf: Bootstrap starting.
I20260811 16:45:01.379482 18650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:01.379838 18650 log.cc:824] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf: Log is configured to *not* fsync() on all Append() calls
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:45:01.380616 18650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf: No bootstrap required, opened a new log
I20260811 16:45:01.382457 18650 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.382619 18650 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:01.382674 18650 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed18328745e44e8db560abbb3ea6dbdf, State: Initialized, Role: FOLLOWER
I20260811 16:45:01.382809 18650 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.383184 18650 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:01.383265 18685 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.383330 18685 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:45:01.384199 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.375222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53886 (local address 127.27.186.125:36973)
0811 16:45:01.375286 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.375288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.375317 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:45:01.375401 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.375402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.375411 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.375464 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.376012 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.376688 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.377777 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.378068 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.378155 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.380807 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.380808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.380808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.380815 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.382507 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.382902 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.382903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.382904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.382963 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.383182 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.383183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.383184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.383321 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.383493 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.384023 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.384100 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 16:45:01.385201 18702 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:45:01.385253 18702 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:45:01.385874 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:45:01.387429 18535 master_runner.cc:186] Error getting master registration for 127.27.186.125:36973: OK, instance_id { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" instance_seqno: 1786466701164501 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:45:01.389737 18535 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:45:01.397037 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.387769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41408 (local address 127.27.186.124:35917)
0811 16:45:01.387804 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.387806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.388785 (+ 979us) server_negotiation.cc:407] Connection header received
0811 16:45:01.388883 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.388884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.388894 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.388925 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.389589 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.390283 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.391198 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.391761 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.391805 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.393339 (+ 1534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.393340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.393340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.393348 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.395684 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.396102 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.396104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.396105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.396164 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.396380 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.396381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.396381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.396513 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.396621 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.396844 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.396944 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:45:01.398056 18526 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } attempt: 3
I20260811 16:45:01.398284 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.387713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53898 (local address 127.27.186.125:36973)
0811 16:45:01.387750 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.387752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.387761 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:45:01.388051 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.388052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.388062 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.388091 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.388891 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.389654 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.390765 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.391049 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.391088 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.394292 (+ 3204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.394294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.394294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.394301 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.396276 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.396668 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.396669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.396669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.396722 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.396930 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.396931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.396931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.397056 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.397124 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.397889 (+ 765us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.397975 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:45:01.403695 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.387393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50036 (local address 127.27.186.126:33889)
0811 16:45:01.387435 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.387437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.387938 (+ 501us) server_negotiation.cc:407] Connection header received
0811 16:45:01.388015 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.388016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.388029 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.388080 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.391592 (+ 3512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.392304 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.394611 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.394932 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.394979 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.400628 (+ 5649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.400629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.400630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.400638 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.402354 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.402780 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.402781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.402781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.402847 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.403070 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.403071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.403071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.403200 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.403277 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.403520 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.403604 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 11 16:45:01 dist-test-slave-gsp7 krb5kdc[18237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466701, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
I20260811 16:45:01.407737 18537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.398286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:35917 (local address 127.0.0.1:41424)
0811 16:45:01.398362 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:01.398372 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:01.398418 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:01.398789 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:01.398790 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:01.398978 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:01.399058 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.399060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.400420 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.400422 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.401836 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:01.401841 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.402370 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.402371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:01.402446 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.402879 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:01.402884 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:01.404450 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:01.406126 (+ 1676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.406127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.406128 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.406296 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.406501 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:01.406502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:01.406502 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:01.406558 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:01.406799 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:01.406800 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:01.406843 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 16:45:01.407548 (+ 705us) client_negotiation.cc:240] Negotiation successful
0811 16:45:01.407657 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 16:45:01.408095 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:01.398630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41424 (local address 127.27.186.124:35917)
0811 16:45:01.398678 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:01.398679 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:01.398686 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:45:01.398705 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:01.398705 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:01.398714 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:01.398783 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:01.399144 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.400174 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.401950 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:01.402247 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:01.402313 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:01.404541 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:01.404542 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:01.404543 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:01.404549 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:01.406050 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.406378 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.406379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.406380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.406435 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:01.406626 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:01.406626 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:01.406627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:01.406734 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:01.406806 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:01.407933 (+ 1127us) server_negotiation.cc:299] Negotiation successful
0811 16:45:01.408007 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:45:01.409353 18526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165: Bootstrap starting.
I20260811 16:45:01.410115 18526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:01.410444 18526 log.cc:824] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:01.411201 18526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165: No bootstrap required, opened a new log
I20260811 16:45:01.412722 18526 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.413373 18526 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:01.413432 18526 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3e45726c5dc4b75a2ec89ab1fe5d165, State: Initialized, Role: FOLLOWER
I20260811 16:45:01.413610 18526 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.413923 18721 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.414029 18526 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:01.414077 18721 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 16:45:01.416018 18740 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:45:01.416123 18740 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:45:01.418372 18405 master_runner.cc:263] No leader master found from master b3e45726c5dc4b75a2ec89ab1fe5d165
I20260811 16:45:01.418422 18405 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:45:01.420907 18721 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:01.420979 18721 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.421168 18721 leader_election.cc:288] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a53c9233616947e2bd3ce02b35948b30 (127.27.186.126:33889), ed18328745e44e8db560abbb3ea6dbdf (127.27.186.124:35917)
I20260811 16:45:01.421587 18606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed18328745e44e8db560abbb3ea6dbdf" is_pre_election: true
I20260811 16:45:01.421728 18606 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3e45726c5dc4b75a2ec89ab1fe5d165 in term 0.
I20260811 16:45:01.422005 18434 leader_election.cc:302] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3e45726c5dc4b75a2ec89ab1fe5d165, ed18328745e44e8db560abbb3ea6dbdf; no voters:
I20260811 16:45:01.422194 18721 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:45:01.422251 18721 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:45:01.422276 18721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:01.423185 18721 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.423288 18721 leader_election.cc:288] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [CANDIDATE]: Term 1 election: Requested vote from peers a53c9233616947e2bd3ce02b35948b30 (127.27.186.126:33889), ed18328745e44e8db560abbb3ea6dbdf (127.27.186.124:35917)
I20260811 16:45:01.423763 18351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a53c9233616947e2bd3ce02b35948b30" is_pre_election: true
I20260811 16:45:01.423918 18351 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3e45726c5dc4b75a2ec89ab1fe5d165 in term 0.
I20260811 16:45:01.424072 18350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a53c9233616947e2bd3ce02b35948b30"
I20260811 16:45:01.424135 18350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:01.425073 18350 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3e45726c5dc4b75a2ec89ab1fe5d165 in term 1.
I20260811 16:45:01.426159 18440 leader_election.cc:302] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a53c9233616947e2bd3ce02b35948b30, b3e45726c5dc4b75a2ec89ab1fe5d165; no voters:
I20260811 16:45:01.426462 18606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed18328745e44e8db560abbb3ea6dbdf"
I20260811 16:45:01.426568 18606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:01.427459 18606 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3e45726c5dc4b75a2ec89ab1fe5d165 in term 1.
I20260811 16:45:01.427714 18721 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:45:01.427865 18721 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [term 1 LEADER]: Becoming Leader. State: Replica: b3e45726c5dc4b75a2ec89ab1fe5d165, State: Running, Role: LEADER
I20260811 16:45:01.427951 18721 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } }
I20260811 16:45:01.428372 18721 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3e45726c5dc4b75a2ec89ab1fe5d165. Latest consensus state: current_term: 1 leader_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.428450 18721 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:01.430120 18751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:45:01.430341 18751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:45:01.432848 18606 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [term 1 FOLLOWER]: Refusing update from remote peer b3e45726c5dc4b75a2ec89ab1fe5d165: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:01.433670 18721 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:01.434211 18350 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [term 1 FOLLOWER]: Refusing update from remote peer b3e45726c5dc4b75a2ec89ab1fe5d165: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:01.434543 18721 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:01.435210 18685 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3e45726c5dc4b75a2ec89ab1fe5d165. Latest consensus state: current_term: 1 leader_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.435303 18685 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:45:01.436404 18662 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3e45726c5dc4b75a2ec89ab1fe5d165. Latest consensus state: current_term: 1 leader_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.436497 18662 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:45:01.437795 18721 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.437872 18721 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:01.438390 18662 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.438477 18662 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:45:01.438726 18752 mvcc.cc:205] Tried to move back new op lower bound from 7317367609066491904 to 7317367609049612288. Current Snapshot: MvccSnapshot[applied={T|T < 7317367609066491904}]
I20260811 16:45:01.438930 18757 mvcc.cc:205] Tried to move back new op lower bound from 7317367609066491904 to 7317367609049612288. Current Snapshot: MvccSnapshot[applied={T|T < 7317367609066491904}]
I20260811 16:45:01.439674 18746 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.439777 18746 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165 [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:01.439973 18751 catalog_manager.cc:1347] Generated new cluster ID: 61efa7daf7f9479e8d79ef47ea2c8d9a
I20260811 16:45:01.440017 18751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:45:01.440243 18685 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a53c9233616947e2bd3ce02b35948b30" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 33889 } } peers { permanent_uuid: "b3e45726c5dc4b75a2ec89ab1fe5d165" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 36973 } } peers { permanent_uuid: "ed18328745e44e8db560abbb3ea6dbdf" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 35917 } } }
I20260811 16:45:01.440308 18685 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:45:01.453992 18754 mvcc.cc:205] Tried to move back new op lower bound from 7317367609066491904 to 7317367609049612288. Current Snapshot: MvccSnapshot[applied={T|T < 7317367609066491904}]
I20260811 16:45:01.471124 18751 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:45:01.471930 18751 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:45:01.479245 18751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3e45726c5dc4b75a2ec89ab1fe5d165: Generated new TSK 0
I20260811 16:45:01.479475 18751 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:45:02.370186 18681 catalog_manager.cc:1259] Loaded cluster ID: 61efa7daf7f9479e8d79ef47ea2c8d9a
I20260811 16:45:02.370266 18681 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30: loading cluster ID for follower catalog manager: success
I20260811 16:45:02.371097 18681 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30: acquiring CA information for follower catalog manager: success
I20260811 16:45:02.371410 18681 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a53c9233616947e2bd3ce02b35948b30: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:45:02.385700 18702 catalog_manager.cc:1259] Loaded cluster ID: 61efa7daf7f9479e8d79ef47ea2c8d9a
I20260811 16:45:02.385797 18702 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf: loading cluster ID for follower catalog manager: success
I20260811 16:45:02.386818 18702 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf: acquiring CA information for follower catalog manager: success
I20260811 16:45:02.387184 18702 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ed18328745e44e8db560abbb3ea6dbdf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:45:02.538789 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 18267
I20260811 16:45:02.548161 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 18405
I20260811 16:45:02.559561 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 18535
2026-08-11T16:45:02Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3083 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:45:02 dist-test-slave-gsp7 krb5kdc[18781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:45:02 dist-test-slave-gsp7 krb5kdc[18781](info): set up 2 sockets
Aug 11 16:45:02 dist-test-slave-gsp7 krb5kdc[18781](info): commencing operation
krb5kdc: starting...
W20260811 16:45:03.856201 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:45:03 dist-test-slave-gsp7 krb5kdc[18781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:45:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:45:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:45:03.984812 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45267
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:45267
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:04.069067 18807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:04.069298 18807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:04.069322 18807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:04.070628 18807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:04.070680 18807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:04.070695 18807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:04.070708 18807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:04.070720 18807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:04.072352 18807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:45267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:04.072620 18807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:04.072871 18807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:04.077795 18822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:04.077801 18818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:04.077802 18817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:04.078552 18807 server_base.cc:1034] running on GCE node
I20260811 16:45:04.078764 18807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:04.079026 18807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:04.080190 18807 hybrid_clock.cc:648] HybridClock initialized: now 1786466704080181 us; error 36 us; skew 500 ppm
Aug 11 16:45:04 dist-test-slave-gsp7 krb5kdc[18781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466704, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:04.082688 18807 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:45:04.083171 18807 webserver.cc:460] Webserver started at http://127.27.186.126:37821/ using document root <none> and password file <none>
I20260811 16:45:04.083415 18807 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:04.083482 18807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:04.083634 18807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:04.084725 18807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454"
format_stamp: "Formatted at 2026-08-11 16:45:04 on dist-test-slave-gsp7"
server_key: "ed1969376a088336b4c2779d7d487ce8"
server_key_iv: "3d81871eb2ec5af50c138223151ab9f5"
server_key_version: "encryptionkey@0"
I20260811 16:45:04.085098 18807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454"
format_stamp: "Formatted at 2026-08-11 16:45:04 on dist-test-slave-gsp7"
server_key: "ed1969376a088336b4c2779d7d487ce8"
server_key_iv: "3d81871eb2ec5af50c138223151ab9f5"
server_key_version: "encryptionkey@0"
I20260811 16:45:04.086576 18807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:45:04.087396 18830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:04.087594 18807 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:04.087699 18807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454"
format_stamp: "Formatted at 2026-08-11 16:45:04 on dist-test-slave-gsp7"
server_key: "ed1969376a088336b4c2779d7d487ce8"
server_key_iv: "3d81871eb2ec5af50c138223151ab9f5"
server_key_version: "encryptionkey@0"
I20260811 16:45:04.087774 18807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:04.107386 18807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:04.109454 18807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:04.109658 18807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:04.113842 18807 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:45267
I20260811 16:45:04.114217 18923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:45267 every 8 connection(s)
I20260811 16:45:04.114303 18807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:45:04.114959 18924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:04.117313 18924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454: Bootstrap starting.
I20260811 16:45:04.117962 18924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:04.118256 18924 log.cc:824] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:04.119038 18924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454: No bootstrap required, opened a new log
I20260811 16:45:04.120621 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 18807
I20260811 16:45:04.120712 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:45:04.120909 28393 external_mini_cluster.cc:1428] Setting key c733431d4022a91c9ee85db7576256c2
I20260811 16:45:04.121042 18924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45267 } }
I20260811 16:45:04.121210 18924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:04.121263 18924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503eb6b9a9fa40fe9fd2bce2c2a0e454, State: Initialized, Role: FOLLOWER
I20260811 16:45:04.121411 18924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45267 } }
I20260811 16:45:04.121546 18924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:45:04.121587 18924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:45:04.121654 18924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:04.122885 18924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45267 } }
I20260811 16:45:04.123005 18924 leader_election.cc:302] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 503eb6b9a9fa40fe9fd2bce2c2a0e454; no voters:
I20260811 16:45:04.123186 18924 leader_election.cc:288] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:45:04.123241 18932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:45:04.123420 18932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [term 1 LEADER]: Becoming Leader. State: Replica: 503eb6b9a9fa40fe9fd2bce2c2a0e454, State: Running, Role: LEADER
I20260811 16:45:04.123448 18924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:04.123628 18932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45267 } }
I20260811 16:45:04.124029 18932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 503eb6b9a9fa40fe9fd2bce2c2a0e454. Latest consensus state: current_term: 1 leader_uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45267 } } }
I20260811 16:45:04.124039 18933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "503eb6b9a9fa40fe9fd2bce2c2a0e454" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45267 } } }
I20260811 16:45:04.124138 18933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:04.124331 18932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454 [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:04.124342 18948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:45:04.124922 18948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:45:04.126916 18948 catalog_manager.cc:1347] Generated new cluster ID: 7f59603805604298a51ea26674483909
I20260811 16:45:04.126986 18948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:45:04 dist-test-slave-gsp7 krb5kdc[18781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:04.131910 18930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:04.121405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49414 (local address 127.27.186.126:45267)
0811 16:45:04.121699 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:04.121710 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:04.121748 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:45:04.121881 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:04.121889 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:04.121944 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:04.122120 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:04.122738 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:04.124113 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:04.125310 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:04.125909 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:04.126036 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:04.128561 (+ 2525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:04.128565 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:04.128565 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:04.128577 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:04.130267 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:04.130730 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:04.130733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:04.130734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:04.130844 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:04.131048 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:04.131049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:04.131049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:04.131286 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:04.131460 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:04.131561 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 16:45:04.131704 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":123,"threads_started":1}
I20260811 16:45:04.133104 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:45:04.134332 18948 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:45:04.134994 18948 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:45:04.164343 18948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 503eb6b9a9fa40fe9fd2bce2c2a0e454: Generated new TSK 0
I20260811 16:45:04.164594 18948 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:45:04.187417 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 18807
2026-08-11T16:45:04Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1631 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:45:04 dist-test-slave-gsp7 krb5kdc[18971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:45:04 dist-test-slave-gsp7 krb5kdc[18971](info): set up 2 sockets
Aug 11 16:45:04 dist-test-slave-gsp7 krb5kdc[18971](info): commencing operation
krb5kdc: starting...
W20260811 16:45:05.473146 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:45:05 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:45:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:45:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:45:05.600117 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:46751
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:46751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:05.687969 18996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:05.688205 18996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:05.688244 18996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:05.689620 18996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:05.689692 18996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:05.689728 18996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:05.689757 18996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:05.689783 18996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:05.691359 18996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:46751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:46751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:05.691643 18996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:05.691885 18996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:05.696914 19006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:05.696887 19011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:05.696895 19007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:05.697062 18996 server_base.cc:1034] running on GCE node
I20260811 16:45:05.697412 18996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:05.697729 18996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:05.698909 18996 hybrid_clock.cc:648] HybridClock initialized: now 1786466705698905 us; error 46 us; skew 500 ppm
Aug 11 16:45:05 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466705, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:05.701584 18996 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:45:05.702014 18996 webserver.cc:460] Webserver started at http://127.27.186.126:33921/ using document root <none> and password file <none>
I20260811 16:45:05.702292 18996 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:05.702387 18996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:05.702533 18996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:05.703766 18996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "640b97e66bc54730831324e1526e9a9c"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "999231813b4c871174301c3113fa68a0"
server_key_iv: "570bb8990c856642d8ff00a093d72216"
server_key_version: "encryptionkey@0"
I20260811 16:45:05.704074 18996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "640b97e66bc54730831324e1526e9a9c"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "999231813b4c871174301c3113fa68a0"
server_key_iv: "570bb8990c856642d8ff00a093d72216"
server_key_version: "encryptionkey@0"
I20260811 16:45:05.705549 18996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:45:05.706311 19024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:05.706516 18996 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:45:05.706614 18996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "640b97e66bc54730831324e1526e9a9c"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "999231813b4c871174301c3113fa68a0"
server_key_iv: "570bb8990c856642d8ff00a093d72216"
server_key_version: "encryptionkey@0"
I20260811 16:45:05.706691 18996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:05.727855 18996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:05.730249 18996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:05.730427 18996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:05.734825 18996 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:46751
I20260811 16:45:05.734880 19101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:46751 every 8 connection(s)
I20260811 16:45:05.735214 18996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:45:05.736116 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 18996
I20260811 16:45:05.736222 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:45:05.736346 19103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:05.736477 28393 external_mini_cluster.cc:1428] Setting key b3b81bab1166ad3b5e1a361b39d0428a
I20260811 16:45:05.739765 19103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Bootstrap starting.
I20260811 16:45:05.740545 19103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:05.740854 19103 log.cc:824] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:05.741662 19103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: No bootstrap required, opened a new log
Aug 11 16:45:05 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:05.744220 19103 raft_consensus.cc:348] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:05.744359 19103 raft_consensus.cc:374] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:05.744383 19103 raft_consensus.cc:729] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640b97e66bc54730831324e1526e9a9c, State: Initialized, Role: FOLLOWER
I20260811 16:45:05.744583 19103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:05.744683 19103 raft_consensus.cc:388] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:45:05.744728 19103 raft_consensus.cc:482] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:45:05.744786 19103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:05.745579 19103 raft_consensus.cc:504] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:05.745698 19103 leader_election.cc:302] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 640b97e66bc54730831324e1526e9a9c; no voters:
I20260811 16:45:05.745877 19103 leader_election.cc:288] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:45:05.745950 19113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:45:05.746136 19103 sys_catalog.cc:564] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:05.746174 19113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 1 LEADER]: Becoming Leader. State: Replica: 640b97e66bc54730831324e1526e9a9c, State: Running, Role: LEADER
I20260811 16:45:05.746358 19113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:05.746708 19114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "640b97e66bc54730831324e1526e9a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } } }
I20260811 16:45:05.746805 19114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:05.747076 19115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 640b97e66bc54730831324e1526e9a9c. Latest consensus state: current_term: 1 leader_uuid: "640b97e66bc54730831324e1526e9a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } } }
I20260811 16:45:05.747370 19115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:05.747572 19127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:45:05.748098 19127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:45:05.748571 19110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:05.737029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33256 (local address 127.27.186.126:46751)
0811 16:45:05.737210 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:05.737217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:05.737243 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:45:05.737911 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:05.737920 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:05.737978 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:05.738096 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:05.738958 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:05.739913 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:05.741030 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:05.741645 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:05.741750 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:05.744327 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:05.744331 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:05.744332 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:05.744350 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:05.746457 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:05.746876 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:05.746879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:05.746880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:05.746989 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:05.747243 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:05.747244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:05.747244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:05.747577 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:05.747725 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:05.748223 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 16:45:05.748361 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
I20260811 16:45:05.749895 19127 catalog_manager.cc:1347] Generated new cluster ID: 2be82947a4104a319cad070456cbc62e
I20260811 16:45:05.749950 19127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:45:05.768285 19127 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:45:05.768833 19127 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:45:05.777271 19127 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Generated new TSK 0
I20260811 16:45:05.777468 19127 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:45:05.812760 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46751
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:05.914527 19159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:05.914721 19159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:05.914744 19159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:05.915797 19159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:05.915839 19159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:05.915864 19159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:45:05.917202 19159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:05.917378 19159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:05.917569 19159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:05.922571 19169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:05.922659 19159 server_base.cc:1034] running on GCE node
W20260811 16:45:05.922578 19172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:05.922586 19168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:05.922971 19159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:05.923157 19159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:05.924312 19159 hybrid_clock.cc:648] HybridClock initialized: now 1786466705924299 us; error 28 us; skew 500 ppm
Aug 11 16:45:05 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466705, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:05.926976 19159 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:45:05.927418 19159 webserver.cc:460] Webserver started at http://127.27.186.65:32945/ using document root <none> and password file <none>
I20260811 16:45:05.927606 19159 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:05.927647 19159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:05.927736 19159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:05.928704 19159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "44721e3377b048f185bf70fa0ba31ef9"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "ac2ded5705016a941b5759767c9eb60f"
server_key_iv: "48b6c101f8be9f6a1a02e851e9923a00"
server_key_version: "encryptionkey@0"
I20260811 16:45:05.929077 19159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "44721e3377b048f185bf70fa0ba31ef9"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "ac2ded5705016a941b5759767c9eb60f"
server_key_iv: "48b6c101f8be9f6a1a02e851e9923a00"
server_key_version: "encryptionkey@0"
I20260811 16:45:05.930446 19159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:45:05.931105 19187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:05.931288 19159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:45:05.931383 19159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "44721e3377b048f185bf70fa0ba31ef9"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "ac2ded5705016a941b5759767c9eb60f"
server_key_iv: "48b6c101f8be9f6a1a02e851e9923a00"
server_key_version: "encryptionkey@0"
I20260811 16:45:05.931456 19159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:05.940717 19159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:05.942533 19159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:05.942691 19159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:05.942903 19159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:05.943220 19159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:05.943284 19159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:05.943326 19159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:05.943354 19159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:05.950205 19159 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:39013
I20260811 16:45:05.950243 19376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:39013 every 8 connection(s)
I20260811 16:45:05.950577 19159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:45:05 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466705, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:05.959473 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 19159
I20260811 16:45:05.959573 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:45:05.959794 28393 external_mini_cluster.cc:1428] Setting key 8607c77d2f2b40be317d735c56b49c25
I20260811 16:45:05.960259 19110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:05.951311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:48081 (local address 127.27.186.126:46751)
0811 16:45:05.951373 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:05.951375 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:05.951624 (+ 249us) server_negotiation.cc:407] Connection header received
0811 16:45:05.952094 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:05.952095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:05.952106 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:05.952164 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:05.953083 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:05.953663 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:05.954622 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:05.954825 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:05.954879 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:05.957155 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:05.957156 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:05.957156 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:05.957163 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:05.958674 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:05.959045 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:05.959046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:05.959047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:05.959098 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:05.959387 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:05.959388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:05.959388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:05.959575 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:05.959662 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:05.960075 (+ 413us) server_negotiation.cc:299] Negotiation successful
0811 16:45:05.960165 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:45:05.960464 19381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:05.951290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:48081)
0811 16:45:05.951465 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:05.951508 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:05.952010 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:05.952224 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:05.952227 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:05.952808 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:05.953003 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:05.953008 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:05.953744 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:05.953745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:05.954546 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:05.954548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:05.954900 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:05.954901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:05.954996 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:05.955672 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:05.955681 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:05.957053 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:05.958750 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:05.958757 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:05.958758 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:05.958978 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:05.959156 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:05.959157 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:05.959157 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:05.959290 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:05.959701 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:05.959709 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:05.959884 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 16:45:05.960049 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 16:45:05.960218 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":103,"threads_started":1}
I20260811 16:45:05.961035 19379 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46751
I20260811 16:45:05.961155 19379 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:05.961337 19379 heartbeater.cc:511] Master 127.27.186.126:46751 requested a full tablet report, sending...
I20260811 16:45:05.961938 19050 ts_manager.cc:194] Registered new tserver with Master: 44721e3377b048f185bf70fa0ba31ef9 (127.27.186.65:39013)
I20260811 16:45:05.962678 19050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:48081
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:45:05.988557 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46751
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:06.072750 19387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:06.072968 19387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:06.072992 19387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:06.074115 19387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:06.074153 19387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:06.074179 19387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:45:06.075565 19387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:06.075750 19387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:06.075937 19387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:06.081139 19400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.081148 19406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.081154 19399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:06.081421 19387 server_base.cc:1034] running on GCE node
I20260811 16:45:06.081688 19387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:06.081934 19387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:06.083101 19387 hybrid_clock.cc:648] HybridClock initialized: now 1786466706083092 us; error 41 us; skew 500 ppm
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:06.085734 19387 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:45:06.086211 19387 webserver.cc:460] Webserver started at http://127.27.186.66:38885/ using document root <none> and password file <none>
I20260811 16:45:06.086447 19387 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:06.086517 19387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:06.086668 19387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:06.087733 19387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "1f5e0ce24627423ca212d1d9413a9bad"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "ce986070443022f5e28fd125409dd5f8"
server_key_iv: "3769a105a995fcc3a0e7c0404b9dd0c8"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.088114 19387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "1f5e0ce24627423ca212d1d9413a9bad"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "ce986070443022f5e28fd125409dd5f8"
server_key_iv: "3769a105a995fcc3a0e7c0404b9dd0c8"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.089550 19387 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:45:06.090394 19417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.090581 19387 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:06.090687 19387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "1f5e0ce24627423ca212d1d9413a9bad"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "ce986070443022f5e28fd125409dd5f8"
server_key_iv: "3769a105a995fcc3a0e7c0404b9dd0c8"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.090773 19387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:06.119424 19387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:06.121591 19387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:06.121763 19387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:06.122027 19387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:06.122359 19387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:06.122416 19387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.122458 19387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:06.122478 19387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.128690 19387 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:46105
I20260811 16:45:06.128810 19601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:46105 every 8 connection(s)
I20260811 16:45:06.129119 19387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:45:06.134382 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 19387
I20260811 16:45:06.134516 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:45:06.134753 28393 external_mini_cluster.cc:1428] Setting key e4b24a5a6e1a08dfc8a5fb0f6ab7ffd2
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:06.139416 19110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.129940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:45625 (local address 127.27.186.126:46751)
0811 16:45:06.130026 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.130029 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.130231 (+ 202us) server_negotiation.cc:407] Connection header received
0811 16:45:06.130804 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.130806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.130819 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.130886 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:06.131879 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.132400 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.133436 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.133690 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.133782 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.136268 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:06.136270 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:06.136270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:06.136278 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:06.137960 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.138367 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.138368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.138369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.138441 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.138693 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.138694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.138694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.138844 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:06.138917 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.139168 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.139276 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:45:06.139423 19604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.129910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:45625)
0811 16:45:06.130102 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.130141 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.130690 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.130973 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.130976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.131564 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:06.131767 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.131772 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.132525 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.132526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.133335 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.133338 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.133797 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.133798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.133928 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.134613 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:06.134624 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:06.136160 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:06.138053 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:06.138060 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:06.138062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:06.138289 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:06.138523 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:06.138524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:06.138524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:06.138624 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:06.138912 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:06.138916 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:06.139038 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.139122 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.139249 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":102,"threads_started":1}
I20260811 16:45:06.140002 19602 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46751
I20260811 16:45:06.140121 19602 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:06.140347 19602 heartbeater.cc:511] Master 127.27.186.126:46751 requested a full tablet report, sending...
I20260811 16:45:06.140832 19050 ts_manager.cc:194] Registered new tserver with Master: 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105)
I20260811 16:45:06.141239 19050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:45625
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:45:06.163894 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46751
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:06.249922 19610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:06.250150 19610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:06.250174 19610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:06.251327 19610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:06.251367 19610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:06.251392 19610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:45:06.252872 19610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:06.253114 19610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:06.253355 19610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:06.258435 19623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.258450 19622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:06.258503 19610 server_base.cc:1034] running on GCE node
W20260811 16:45:06.258467 19627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:06.258888 19610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:06.259094 19610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:06.260237 19610 hybrid_clock.cc:648] HybridClock initialized: now 1786466706260225 us; error 27 us; skew 500 ppm
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:06.265990 19610 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:45:06.266426 19610 webserver.cc:460] Webserver started at http://127.27.186.67:34811/ using document root <none> and password file <none>
I20260811 16:45:06.266609 19610 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:06.266651 19610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:06.266739 19610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:06.267817 19610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "2e12a7fd2f1f468a85dc9ea558c62a60"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "e54cde9205a65d9e07167bc72ad00c12"
server_key_iv: "1a48c8667958628bb73f2a58540742bb"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.268136 19610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "2e12a7fd2f1f468a85dc9ea558c62a60"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "e54cde9205a65d9e07167bc72ad00c12"
server_key_iv: "1a48c8667958628bb73f2a58540742bb"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.269454 19610 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:45:06.270246 19637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.270452 19610 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:06.270553 19610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "2e12a7fd2f1f468a85dc9ea558c62a60"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "e54cde9205a65d9e07167bc72ad00c12"
server_key_iv: "1a48c8667958628bb73f2a58540742bb"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.270632 19610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:06.283020 19610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:06.285418 19610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:06.285642 19610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:06.285897 19610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:06.286224 19610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:06.286279 19610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.286321 19610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:06.286356 19610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.292531 19610 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:38291
I20260811 16:45:06.292578 19831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:38291 every 8 connection(s)
I20260811 16:45:06.292943 19610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:06.299386 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 19610
I20260811 16:45:06.299487 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:45:06.299685 28393 external_mini_cluster.cc:1428] Setting key cf66f4b82f8c77b42d3c51ed00fa2638
I20260811 16:45:06.302599 19110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.293710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:59601 (local address 127.27.186.126:46751)
0811 16:45:06.293781 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.293784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.294009 (+ 225us) server_negotiation.cc:407] Connection header received
0811 16:45:06.294578 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.294603 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.294617 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.294667 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:06.295639 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.296156 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.297199 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.297413 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.297512 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.299760 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:06.299762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:06.299762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:06.299770 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:06.301363 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.301806 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.301807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.301807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.301857 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.302076 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.302077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.302077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.302178 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:06.302229 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.302473 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.302536 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:45:06.302747 19837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.293681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:59601)
0811 16:45:06.293855 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.293901 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.294462 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.294738 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.294742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.295330 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:06.295537 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.295542 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.296261 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.296262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.297090 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.297092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.297524 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.297526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.297655 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.298110 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:06.298118 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:06.299647 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:06.301448 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:06.301456 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:06.301457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:06.301742 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:06.301917 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:06.301918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:06.301918 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:06.302023 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:06.302233 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:06.302237 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:06.302351 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.302436 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.302555 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
I20260811 16:45:06.303206 19833 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46751
I20260811 16:45:06.303314 19833 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:06.303493 19833 heartbeater.cc:511] Master 127.27.186.126:46751 requested a full tablet report, sending...
I20260811 16:45:06.303857 19050 ts_manager.cc:194] Registered new tserver with Master: 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291)
I20260811 16:45:06.304231 19050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:59601
I20260811 16:45:06.311563 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:45:06.319042 19110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.313099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33272 (local address 127.27.186.126:46751)
0811 16:45:06.313193 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.313195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.313257 (+ 62us) server_negotiation.cc:407] Connection header received
0811 16:45:06.313325 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.313325 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.313334 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.313372 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:06.313972 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.314431 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.315127 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.315299 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.315348 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.316553 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:06.316554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:06.316554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:06.316559 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:06.317812 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.318206 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.318207 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.318207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.318266 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.318453 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.318454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.318454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.318603 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:06.318684 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.318853 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.318930 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 16:45:06.320735 19050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:45:06.322417 19050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:45:06.329023 19855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.324954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44652 (local address 127.27.186.65:39013)
0811 16:45:06.325117 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.325121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.325439 (+ 318us) server_negotiation.cc:407] Connection header received
0811 16:45:06.325518 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.325521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.325539 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.325614 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:06.325779 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.326480 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.328059 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.328609 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.328698 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.328761 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.328894 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.328934 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
I20260811 16:45:06.329005 19858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.324833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:39013 (local address 127.0.0.1:44652)
0811 16:45:06.325220 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.325269 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.325340 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.325633 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.325636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.325639 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:06.325709 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.325712 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.326583 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.326584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.327952 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.327956 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.328697 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.328698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.328785 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.328798 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.328870 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.328927 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":47,"thread_start_us":72,"threads_started":1}
I20260811 16:45:06.329394 19856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.325002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51372 (local address 127.27.186.66:46105)
0811 16:45:06.325376 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.325381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.325393 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:45:06.325439 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.325441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.325459 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.325565 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:06.325817 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.326516 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.328015 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.328722 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.328806 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.328859 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.329245 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.329298 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":94,"threads_started":1}
I20260811 16:45:06.329631 19852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.324841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46105 (local address 127.0.0.1:51372)
0811 16:45:06.325221 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.325266 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.325339 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.325655 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.325656 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.325659 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:06.325726 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.325729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.326639 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.326640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.327884 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.327887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.328897 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.328898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.328965 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.328969 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.329022 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.329061 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":11,"thread_start_us":87,"threads_started":1}
I20260811 16:45:06.329852 19263 tablet_service.cc:1467] Processing CreateTablet for tablet 1b24583094ea45ef8aa61aa5e94c0cb2 (DEFAULT_TABLE table=test-table [id=504a120635f0419394aaf6cad1914f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:06.330258 19263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b24583094ea45ef8aa61aa5e94c0cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:06.330510 19494 tablet_service.cc:1467] Processing CreateTablet for tablet 1b24583094ea45ef8aa61aa5e94c0cb2 (DEFAULT_TABLE table=test-table [id=504a120635f0419394aaf6cad1914f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:06.330864 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.325311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52168 (local address 127.27.186.67:38291)
0811 16:45:06.325548 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.325552 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.326779 (+ 1227us) server_negotiation.cc:407] Connection header received
0811 16:45:06.326835 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.326837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.326853 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.326937 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:06.327085 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.328121 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.329695 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.330453 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.330547 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.330607 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.330711 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.330758 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":84,"threads_started":1}
I20260811 16:45:06.330895 19494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b24583094ea45ef8aa61aa5e94c0cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:06.330891 19853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.325073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38291 (local address 127.0.0.1:52168)
0811 16:45:06.326695 (+ 1622us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.326706 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.326764 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.326953 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.326954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.326957 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:06.327004 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.327006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.328223 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.328224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.329584 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.329587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.330553 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.330555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.330627 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.330633 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.330772 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.330819 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1594,"thread_start_us":84,"threads_started":1}
I20260811 16:45:06.331894 19723 tablet_service.cc:1467] Processing CreateTablet for tablet 1b24583094ea45ef8aa61aa5e94c0cb2 (DEFAULT_TABLE table=test-table [id=504a120635f0419394aaf6cad1914f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:06.332238 19723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b24583094ea45ef8aa61aa5e94c0cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:06.333659 19861 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Bootstrap starting.
I20260811 16:45:06.334398 19861 tablet_bootstrap.cc:654] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:06.334949 19861 log.cc:824] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:06.335578 19868 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: Bootstrap starting.
I20260811 16:45:06.335806 19861 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: No bootstrap required, opened a new log
I20260811 16:45:06.335850 19862 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Bootstrap starting.
I20260811 16:45:06.335911 19861 ts_tablet_manager.cc:1397] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:06.336304 19868 tablet_bootstrap.cc:654] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:06.336496 19862 tablet_bootstrap.cc:654] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:06.336923 19868 log.cc:824] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:06.337123 19862 log.cc:824] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:06.337770 19868 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: No bootstrap required, opened a new log
I20260811 16:45:06.337850 19868 ts_tablet_manager.cc:1397] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:06.338369 19861 raft_consensus.cc:348] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.338551 19861 raft_consensus.cc:374] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:06.338589 19861 raft_consensus.cc:729] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f5e0ce24627423ca212d1d9413a9bad, State: Initialized, Role: FOLLOWER
I20260811 16:45:06.338712 19861 consensus_queue.cc:260] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.339017 19861 ts_tablet_manager.cc:1428] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:45:06.339061 19602 heartbeater.cc:503] Master 127.27.186.126:46751 was elected leader, sending a full tablet report...
I20260811 16:45:06.339777 19868 raft_consensus.cc:348] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.339953 19868 raft_consensus.cc:374] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:06.340006 19868 raft_consensus.cc:729] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e12a7fd2f1f468a85dc9ea558c62a60, State: Initialized, Role: FOLLOWER
I20260811 16:45:06.340131 19868 consensus_queue.cc:260] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.340437 19868 ts_tablet_manager.cc:1428] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 16:45:06.340500 19833 heartbeater.cc:503] Master 127.27.186.126:46751 was elected leader, sending a full tablet report...
I20260811 16:45:06.341131 19862 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: No bootstrap required, opened a new log
I20260811 16:45:06.341223 19862 ts_tablet_manager.cc:1397] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 16:45:06.342684 19862 raft_consensus.cc:348] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.342806 19862 raft_consensus.cc:374] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:06.342828 19862 raft_consensus.cc:729] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44721e3377b048f185bf70fa0ba31ef9, State: Initialized, Role: FOLLOWER
I20260811 16:45:06.342943 19862 consensus_queue.cc:260] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.343222 19862 ts_tablet_manager.cc:1428] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:06.343288 19379 heartbeater.cc:503] Master 127.27.186.126:46751 was elected leader, sending a full tablet report...
W20260811 16:45:06.379758 19603 tablet.cc:2369] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:45:06.451385 19380 tablet.cc:2369] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:45:06.475548 19877 raft_consensus.cc:482] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:06.475682 19877 raft_consensus.cc:504] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.476074 19877 leader_election.cc:288] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291), 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105)
I20260811 16:45:06.480438 19859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.476341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:43491 (local address 127.27.186.67:38291)
0811 16:45:06.476390 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.476392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.476502 (+ 110us) server_negotiation.cc:407] Connection header received
0811 16:45:06.476610 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.476612 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.476623 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.476684 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:06.476922 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.477712 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.479360 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.479973 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.480062 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.480072 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.480303 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.480360 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:45:06.480438 19856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.476367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:59679 (local address 127.27.186.66:46105)
0811 16:45:06.476427 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.476429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.476522 (+ 93us) server_negotiation.cc:407] Connection header received
0811 16:45:06.476603 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.476604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.476615 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.476684 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:06.476942 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.477705 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.479360 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.479987 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.480062 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.480072 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.480309 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.480360 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:45:06.480496 19885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.476253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38291 (local address 127.27.186.65:43491)
0811 16:45:06.476420 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.476432 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.476517 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.476706 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.476706 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.476709 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:06.476849 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.476851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.477823 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.477823 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.479243 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.479246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.480077 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.480079 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.480166 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.480175 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.480237 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.480296 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":99,"thread_start_us":123,"threads_started":1}
I20260811 16:45:06.480499 19878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.476262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46105 (local address 127.27.186.65:59679)
0811 16:45:06.476437 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.476447 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.476517 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.476705 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.476706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.476710 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:06.476838 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.476841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.477821 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.477823 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.479243 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.479246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.480079 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.480080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.480166 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.480173 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.480237 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.480296 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":86,"thread_start_us":73,"threads_started":1}
I20260811 16:45:06.480969 19761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b24583094ea45ef8aa61aa5e94c0cb2" candidate_uuid: "44721e3377b048f185bf70fa0ba31ef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" is_pre_election: true
I20260811 16:45:06.480989 19529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b24583094ea45ef8aa61aa5e94c0cb2" candidate_uuid: "44721e3377b048f185bf70fa0ba31ef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f5e0ce24627423ca212d1d9413a9bad" is_pre_election: true
I20260811 16:45:06.481187 19529 raft_consensus.cc:2454] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44721e3377b048f185bf70fa0ba31ef9 in term 0.
I20260811 16:45:06.481187 19761 raft_consensus.cc:2454] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44721e3377b048f185bf70fa0ba31ef9 in term 0.
I20260811 16:45:06.481515 19192 leader_election.cc:302] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f5e0ce24627423ca212d1d9413a9bad, 44721e3377b048f185bf70fa0ba31ef9; no voters:
I20260811 16:45:06.481776 19877 raft_consensus.cc:2781] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:45:06.481843 19877 raft_consensus.cc:482] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:45:06.481863 19877 raft_consensus.cc:3037] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:06.482671 19877 raft_consensus.cc:504] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.482844 19877 leader_election.cc:288] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 1 election: Requested vote from peers 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291), 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105)
I20260811 16:45:06.482985 19761 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b24583094ea45ef8aa61aa5e94c0cb2" candidate_uuid: "44721e3377b048f185bf70fa0ba31ef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60"
I20260811 16:45:06.483050 19529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b24583094ea45ef8aa61aa5e94c0cb2" candidate_uuid: "44721e3377b048f185bf70fa0ba31ef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f5e0ce24627423ca212d1d9413a9bad"
I20260811 16:45:06.483083 19761 raft_consensus.cc:3037] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:06.483150 19529 raft_consensus.cc:3037] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:06.484123 19529 raft_consensus.cc:2454] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44721e3377b048f185bf70fa0ba31ef9 in term 1.
I20260811 16:45:06.484122 19761 raft_consensus.cc:2454] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44721e3377b048f185bf70fa0ba31ef9 in term 1.
I20260811 16:45:06.484334 19191 leader_election.cc:302] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e12a7fd2f1f468a85dc9ea558c62a60, 44721e3377b048f185bf70fa0ba31ef9; no voters:
I20260811 16:45:06.484436 19877 raft_consensus.cc:2781] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:45:06.484669 19877 raft_consensus.cc:686] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 1 LEADER]: Becoming Leader. State: Replica: 44721e3377b048f185bf70fa0ba31ef9, State: Running, Role: LEADER
I20260811 16:45:06.484898 19877 consensus_queue.cc:237] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.485816 19050 catalog_manager.cc:5495] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44721e3377b048f185bf70fa0ba31ef9 (127.27.186.65). New cstate: current_term: 1 leader_uuid: "44721e3377b048f185bf70fa0ba31ef9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } health_report { overall_health: UNKNOWN } } }
I20260811 16:45:06.514621 19855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.511952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44662 (local address 127.27.186.65:39013)
0811 16:45:06.512034 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.512036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.512046 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:45:06.512092 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.512093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.512116 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.512206 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:45:06.512371 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.512859 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.513757 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.513986 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.514066 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.514255 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:45:06.514376 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:45:06.514479 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.514505 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.514527 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 16:45:06.516628 19529 raft_consensus.cc:1261] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 1 FOLLOWER]: Refusing update from remote peer 44721e3377b048f185bf70fa0ba31ef9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:06.516628 19761 raft_consensus.cc:1261] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 1 FOLLOWER]: Refusing update from remote peer 44721e3377b048f185bf70fa0ba31ef9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:06.517025 19877 consensus_queue.cc:1035] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:06.517174 19889 consensus_queue.cc:1035] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:06.520277 19896 mvcc.cc:205] Tried to move back new op lower bound from 7317367629889376256 to 7317367629762838528. Current Snapshot: MvccSnapshot[applied={T|T < 7317367629889376256}]
I20260811 16:45:06.520157 19895 mvcc.cc:205] Tried to move back new op lower bound from 7317367629889376256 to 7317367629762838528. Current Snapshot: MvccSnapshot[applied={T|T < 7317367629889376256}]
I20260811 16:45:06.521984 19050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:45:06.522084 19050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:45:06.522867 19050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Sending DeleteTablet for 3 replicas of tablet 1b24583094ea45ef8aa61aa5e94c0cb2
I20260811 16:45:06.523195 19263 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b24583094ea45ef8aa61aa5e94c0cb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:06 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:44652
I20260811 16:45:06.523267 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 19159
I20260811 16:45:06.523267 19723 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b24583094ea45ef8aa61aa5e94c0cb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:06 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:52168
I20260811 16:45:06.527762 19909 tablet_replica.cc:330] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: stopping tablet replica
I20260811 16:45:06.527884 19909 raft_consensus.cc:2229] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:06.528016 19909 raft_consensus.cc:2258] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:06.533078 19494 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b24583094ea45ef8aa61aa5e94c0cb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:06 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:51372
I20260811 16:45:06.533346 19909 ts_tablet_manager.cc:1905] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:06.535821 19909 ts_tablet_manager.cc:1918] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:06.535912 19909 log.cc:1196] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/1b24583094ea45ef8aa61aa5e94c0cb2
I20260811 16:45:06.536100 19910 tablet_replica.cc:330] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: stopping tablet replica
I20260811 16:45:06.536209 19909 ts_tablet_manager.cc:1939] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 2e12a7fd2f1f468a85dc9ea558c62a60: Deleting consensus metadata
I20260811 16:45:06.536266 19910 raft_consensus.cc:2229] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:06.536396 19910 raft_consensus.cc:2258] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:06.536736 19027 catalog_manager.cc:4841] TS 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291): tablet 1b24583094ea45ef8aa61aa5e94c0cb2 (table test-table [id=504a120635f0419394aaf6cad1914f8d]) successfully deleted
I20260811 16:45:06.536897 19910 ts_tablet_manager.cc:1905] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:06.538298 19910 ts_tablet_manager.cc:1918] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:06.538393 19910 log.cc:1196] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/1b24583094ea45ef8aa61aa5e94c0cb2
I20260811 16:45:06.538669 19910 ts_tablet_manager.cc:1939] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 1f5e0ce24627423ca212d1d9413a9bad: Deleting consensus metadata
I20260811 16:45:06.539131 19028 catalog_manager.cc:4841] TS 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105): tablet 1b24583094ea45ef8aa61aa5e94c0cb2 (table test-table [id=504a120635f0419394aaf6cad1914f8d]) successfully deleted
W20260811 16:45:06.540333 19027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:39013 (error 108)
I20260811 16:45:06.540374 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 19387
I20260811 16:45:06.548990 19853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.548835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:39013 (local address 127.0.0.1:44666)
0811 16:45:06.548899 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.548947 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 16:45:06.549235 19027 catalog_manager.cc:4584] TS 44721e3377b048f185bf70fa0ba31ef9 (127.27.186.65:39013): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1b24583094ea45ef8aa61aa5e94c0cb2: Network error: Client connection negotiation failed: client connection to 127.27.186.65:39013: connect: Connection refused (error 111)
I20260811 16:45:06.555380 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 19610
I20260811 16:45:06.566493 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 18996
I20260811 16:45:06.578513 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:46751
--webserver_interface=127.27.186.126
--webserver_port=33921
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:46751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:06.664896 19912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:06.665143 19912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:06.665182 19912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:06.666359 19912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:06.666435 19912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:06.666462 19912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:06.666491 19912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:06.666538 19912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:06.668072 19912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:46751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:46751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=33921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:06.668359 19912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:06.668606 19912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:06.678788 19922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.678830 19923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.678788 19928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:06.678831 19912 server_base.cc:1034] running on GCE node
I20260811 16:45:06.679255 19912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:06.679607 19912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:06.680769 19912 hybrid_clock.cc:648] HybridClock initialized: now 1786466706680758 us; error 43 us; skew 500 ppm
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:06.683320 19912 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:45:06.683797 19912 webserver.cc:460] Webserver started at http://127.27.186.126:33921/ using document root <none> and password file <none>
I20260811 16:45:06.684005 19912 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:06.684058 19912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:06.686084 19912 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:06.686729 19940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.686933 19912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:45:06.687043 19912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "640b97e66bc54730831324e1526e9a9c"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "999231813b4c871174301c3113fa68a0"
server_key_iv: "570bb8990c856642d8ff00a093d72216"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.687458 19912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:06.699160 19912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:06.701807 19912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:06.701923 19912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:06.706103 19912 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:46751
I20260811 16:45:06.706136 20034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:46751 every 8 connection(s)
I20260811 16:45:06.706543 19912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:45:06.708241 20035 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:45:06.708994 20035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Bootstrap starting.
I20260811 16:45:06.714267 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 19912
I20260811 16:45:06.714627 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:39013
--local_ip_for_outbound_sockets=127.27.186.65
--tserver_master_addrs=127.27.186.126:46751
--webserver_port=32945
--webserver_interface=127.27.186.65
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:06.719699 20035 log.cc:824] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:06.723912 20035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:45:06.724366 20035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Bootstrap complete.
I20260811 16:45:06.726895 20035 raft_consensus.cc:348] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:06.727136 20035 raft_consensus.cc:729] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640b97e66bc54730831324e1526e9a9c, State: Initialized, Role: FOLLOWER
I20260811 16:45:06.727305 20035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:06.727380 20035 raft_consensus.cc:388] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:45:06.727447 20035 raft_consensus.cc:482] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:45:06.727499 20035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:45:06.728542 20035 raft_consensus.cc:504] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:06.728632 20035 leader_election.cc:302] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 640b97e66bc54730831324e1526e9a9c; no voters:
I20260811 16:45:06.728852 20035 leader_election.cc:288] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:45:06.728889 20043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:45:06.729055 20043 raft_consensus.cc:686] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 2 LEADER]: Becoming Leader. State: Replica: 640b97e66bc54730831324e1526e9a9c, State: Running, Role: LEADER
I20260811 16:45:06.729193 20035 sys_catalog.cc:564] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:06.729218 20043 consensus_queue.cc:237] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:06.729720 20045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "640b97e66bc54730831324e1526e9a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } } }
I20260811 16:45:06.729804 20045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:06.730221 20046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 640b97e66bc54730831324e1526e9a9c. Latest consensus state: current_term: 2 leader_uuid: "640b97e66bc54730831324e1526e9a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } } }
I20260811 16:45:06.730299 20046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:06.730448 20053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:45:06.731246 20053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:45:06.731352 20053 catalog_manager.cc:1259] Loaded cluster ID: 2be82947a4104a319cad070456cbc62e
I20260811 16:45:06.731446 20053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:45:06.731876 20053 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 16:45:06.736537 20053 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 16:45:06.739215 20053 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:45:06.739461 20053 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Loaded TSK: 0
I20260811 16:45:06.739693 20053 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:45:06.803685 20039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:06.803936 20039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:06.803978 20039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:06.805148 20039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:06.805217 20039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:06.805262 20039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:45:06.806831 20039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:39013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=32945
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:06.807119 20039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:06.807375 20039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:06.812686 20092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.812721 20088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.812885 20089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:06.812978 20039 server_base.cc:1034] running on GCE node
I20260811 16:45:06.813205 20039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:06.813532 20039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:06.814694 20039 hybrid_clock.cc:648] HybridClock initialized: now 1786466706814666 us; error 46 us; skew 500 ppm
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:06.817267 20039 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:45:06.817787 20039 webserver.cc:460] Webserver started at http://127.27.186.65:32945/ using document root <none> and password file <none>
I20260811 16:45:06.818050 20039 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:06.818110 20039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:06.819521 20039 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:45:06.820267 20109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.820465 20039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:06.820571 20039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "44721e3377b048f185bf70fa0ba31ef9"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "ac2ded5705016a941b5759767c9eb60f"
server_key_iv: "48b6c101f8be9f6a1a02e851e9923a00"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.820921 20039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:06.846596 20039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:06.849054 20039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:06.849237 20039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:06.849553 20039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:06.850167 20122 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:45:06.851768 20039 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:45:06.851826 20039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:45:06.851854 20039 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:45:06.852651 20039 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:45:06.852697 20039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:45:06.852746 20122 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Bootstrap starting.
I20260811 16:45:06.860781 20039 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:39013
I20260811 16:45:06.860816 20287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:39013 every 8 connection(s)
I20260811 16:45:06.861369 20039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:45:06.862517 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 20039
I20260811 16:45:06.862815 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:46105
--local_ip_for_outbound_sockets=127.27.186.66
--tserver_master_addrs=127.27.186.126:46751
--webserver_port=38885
--webserver_interface=127.27.186.66
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:06.867800 20122 log.cc:824] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Log is configured to *not* fsync() on all Append() calls
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:06.870586 20122 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:45:06.870944 20122 tablet_bootstrap.cc:492] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Bootstrap complete.
I20260811 16:45:06.872174 20122 ts_tablet_manager.cc:1397] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.007s
I20260811 16:45:06.873286 20122 raft_consensus.cc:348] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.873888 20122 raft_consensus.cc:729] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44721e3377b048f185bf70fa0ba31ef9, State: Initialized, Role: FOLLOWER
I20260811 16:45:06.874051 20122 consensus_queue.cc:260] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } }
I20260811 16:45:06.874364 20122 ts_tablet_manager.cc:1428] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Time spent starting tablet: real 0.002s user 0.002s sys 0.003s
I20260811 16:45:06.874837 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.862255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:52759)
0811 16:45:06.862475 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.862526 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.863014 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.863472 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.863475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.863768 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:06.863960 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.863964 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.865631 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.865633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.867118 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.867122 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.867729 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.867730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.867873 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.868451 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:06.868471 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:06.870400 (+ 1929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:06.872994 (+ 2594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:06.873000 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:06.873002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:06.873296 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:06.873663 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:06.873664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:06.873665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:06.873791 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:06.874284 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:06.874290 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:06.874441 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.874570 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.874699 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":108,"threads_started":1}
I20260811 16:45:06.875239 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.862345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:52759 (local address 127.27.186.126:46751)
0811 16:45:06.862585 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.862592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.862631 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:45:06.863243 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.863248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.863301 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.863441 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:06.864088 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.865510 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.867230 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.867610 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.867691 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.870523 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:06.870528 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:06.870528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:06.870542 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:06.872897 (+ 2355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.873396 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.873400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.873400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.873554 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.873871 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.873872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.873872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.874207 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:06.874319 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.874660 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.874822 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":112,"threads_started":1}
I20260811 16:45:06.875926 20288 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46751
I20260811 16:45:06.876037 20288 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:06.876247 20288 heartbeater.cc:511] Master 127.27.186.126:46751 requested a full tablet report, sending...
I20260811 16:45:06.877036 19972 ts_manager.cc:194] Registered new tserver with Master: 44721e3377b048f185bf70fa0ba31ef9 (127.27.186.65:39013)
I20260811 16:45:06.878121 19972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:52759
I20260811 16:45:06.878993 20288 heartbeater.cc:503] Master 127.27.186.126:46751 was elected leader, sending a full tablet report...
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.65@KRBTEST.COM
I20260811 16:45:06.886762 20312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.877663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:39013 (local address 127.0.0.1:44672)
0811 16:45:06.877862 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:06.877907 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:06.877975 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:06.878704 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:06.878709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:06.879029 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:06.879087 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.879089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.880374 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.880375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.880948 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:06.880950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.881600 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.881601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:06.881660 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.882180 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:06.882185 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:06.883652 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:06.885660 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:06.885667 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:06.885669 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:06.885866 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:06.886080 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:06.886081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:06.886081 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:06.886136 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:06.886467 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:06.886473 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:06.886516 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 16:45:06.886580 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:45:06.886677 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":102,"threads_started":1}
I20260811 16:45:06.886832 20313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:06.878397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44672 (local address 127.27.186.65:39013)
0811 16:45:06.878549 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:06.878553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:06.878564 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:45:06.878599 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:06.878601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:06.878615 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:06.878690 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:06.879182 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.880277 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.881040 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:06.881522 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:06.881593 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:06.883740 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:06.883748 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:06.883748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:06.883756 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:06.885585 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.885945 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.885948 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.885949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.886014 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:06.886195 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:06.886195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:06.886196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:06.886403 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:06.886484 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:06.886635 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 16:45:06.886735 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
I20260811 16:45:06.887406 20188 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b24583094ea45ef8aa61aa5e94c0cb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:06 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:44672
I20260811 16:45:06.888031 20314 tablet_replica.cc:330] stopping tablet replica
I20260811 16:45:06.888147 20314 raft_consensus.cc:2229] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:06.888221 20314 raft_consensus.cc:2258] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:06.888574 20314 ts_tablet_manager.cc:1905] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:06.890666 20314 ts_tablet_manager.cc:1918] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:06.890733 20314 log.cc:1196] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/1b24583094ea45ef8aa61aa5e94c0cb2
I20260811 16:45:06.890972 20314 ts_tablet_manager.cc:1939] T 1b24583094ea45ef8aa61aa5e94c0cb2 P 44721e3377b048f185bf70fa0ba31ef9: Deleting consensus metadata
I20260811 16:45:06.891505 19942 catalog_manager.cc:4841] TS 44721e3377b048f185bf70fa0ba31ef9 (127.27.186.65:39013): tablet 1b24583094ea45ef8aa61aa5e94c0cb2 (table test-table [id=504a120635f0419394aaf6cad1914f8d]) successfully deleted
W20260811 16:45:06.955595 20296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:06.955811 20296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:06.955876 20296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:06.957235 20296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:06.957281 20296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:06.957310 20296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:45:06.958777 20296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:46105
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=38885
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:06.958987 20296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:06.959167 20296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:06.964500 20326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.964490 20322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:06.964491 20321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:06.964629 20296 server_base.cc:1034] running on GCE node
I20260811 16:45:06.964958 20296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:06.965265 20296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:06.966475 20296 hybrid_clock.cc:648] HybridClock initialized: now 1786466706966426 us; error 57 us; skew 500 ppm
Aug 11 16:45:06 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:06.969020 20296 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:45:06.969523 20296 webserver.cc:460] Webserver started at http://127.27.186.66:38885/ using document root <none> and password file <none>
I20260811 16:45:06.969738 20296 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:06.969794 20296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:06.971181 20296 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:06.971732 20339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.971947 20296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:06.972061 20296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "1f5e0ce24627423ca212d1d9413a9bad"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "ce986070443022f5e28fd125409dd5f8"
server_key_iv: "3769a105a995fcc3a0e7c0404b9dd0c8"
server_key_version: "encryptionkey@0"
I20260811 16:45:06.972450 20296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:06.991997 20296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:06.994120 20296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:06.994287 20296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:06.994551 20296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:06.994890 20296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:06.994926 20296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:06.994951 20296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:06.995000 20296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:07.001353 20296 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:46105
I20260811 16:45:07.001401 20527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:46105 every 8 connection(s)
I20260811 16:45:07.001822 20296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:45:07 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466706, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:07.011374 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.002646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:52751 (local address 127.27.186.126:46751)
0811 16:45:07.002711 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.002713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.002957 (+ 244us) server_negotiation.cc:407] Connection header received
0811 16:45:07.003473 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.003474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.003490 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.003554 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:07.004556 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.005113 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.006137 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.006367 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.006432 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.008678 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:07.008679 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:07.008680 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:07.008687 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:07.010198 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:07.010572 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:07.010573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:07.010573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:07.010627 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:07.010841 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:07.010841 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:07.010842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:07.010949 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:07.011000 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.011232 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.011305 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:45:07.011572 20534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.002613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:52751)
0811 16:45:07.002808 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:07.002853 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:07.003367 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:07.003640 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:07.003644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:07.004246 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:07.004446 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.004451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.005198 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.005198 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.006022 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.006024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.006453 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.006453 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.006559 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.007051 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:07.007060 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:07.008572 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:07.010276 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:07.010283 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:07.010284 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:07.010501 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:07.010689 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:07.010690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:07.010690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:07.010786 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:07.011005 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:07.011009 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:07.011123 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 16:45:07.011206 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:45:07.011328 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
I20260811 16:45:07.011835 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 20296
I20260811 16:45:07.012141 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:38291
--local_ip_for_outbound_sockets=127.27.186.67
--tserver_master_addrs=127.27.186.126:46751
--webserver_port=34811
--webserver_interface=127.27.186.67
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:07.012328 20528 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46751
I20260811 16:45:07.012434 20528 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:07.012637 20528 heartbeater.cc:511] Master 127.27.186.126:46751 requested a full tablet report, sending...
I20260811 16:45:07.013063 19972 ts_manager.cc:194] Registered new tserver with Master: 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105)
I20260811 16:45:07.013450 19972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:52751
W20260811 16:45:07.099895 20535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:07.100116 20535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:07.100142 20535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:07.101330 20535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:07.101382 20535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:07.101410 20535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:45:07.102972 20535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:38291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=34811
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:07.103231 20535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:07.103516 20535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:07.108734 20542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:07.108744 20544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:07.108747 20541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:07.109098 20535 server_base.cc:1034] running on GCE node
I20260811 16:45:07.109323 20535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:07.109619 20535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:07.110845 20535 hybrid_clock.cc:648] HybridClock initialized: now 1786466707110819 us; error 25 us; skew 500 ppm
Aug 11 16:45:07 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466707, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:07.113780 20535 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:45:07.114264 20535 webserver.cc:460] Webserver started at http://127.27.186.67:34811/ using document root <none> and password file <none>
I20260811 16:45:07.114497 20535 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:07.114583 20535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:07.115958 20535 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:07.116575 20563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:07.116746 20535 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:45:07.116855 20535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "2e12a7fd2f1f468a85dc9ea558c62a60"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "e54cde9205a65d9e07167bc72ad00c12"
server_key_iv: "1a48c8667958628bb73f2a58540742bb"
server_key_version: "encryptionkey@0"
I20260811 16:45:07.117219 20535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:07.149646 20535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:07.151736 20535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:07.151912 20535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:07.152195 20535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:07.152530 20535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:07.152587 20535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:07.152629 20535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:07.152658 20535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:07.159024 20535 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:38291
I20260811 16:45:07.159097 20766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:38291 every 8 connection(s)
I20260811 16:45:07.159475 20535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:45:07 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466707, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:07.168870 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.160296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:58283 (local address 127.27.186.126:46751)
0811 16:45:07.160398 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.160401 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.160607 (+ 206us) server_negotiation.cc:407] Connection header received
0811 16:45:07.161163 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.161165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.161175 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.161227 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:07.162283 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.162765 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.163732 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.163916 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.163973 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.166127 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:07.166128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:07.166129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:07.166137 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:07.167393 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:07.167826 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:07.167828 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:07.167828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:07.167893 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:07.168166 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:07.168167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:07.168168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:07.168291 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:07.168370 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.168671 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.168775 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 16:45:07.169157 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 20535
I20260811 16:45:07.169467 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.160201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:58283)
0811 16:45:07.160441 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:07.160493 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:07.161062 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:07.161297 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:07.161300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:07.161980 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:07.162196 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.162202 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.162846 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.162847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.163655 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.163657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.163996 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.163997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.164095 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.164550 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:07.164558 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:07.166017 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:07.167500 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:07.167509 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:07.167511 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:07.167740 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:07.167981 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:07.167982 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:07.167983 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:07.168094 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:07.168361 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:07.168368 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:07.168527 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 16:45:07.168635 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:45:07.168801 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":103,"threads_started":1}
I20260811 16:45:07.169917 20767 heartbeater.cc:347] Connected to a master server at 127.27.186.126:46751
I20260811 16:45:07.170037 20767 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:07.170236 20767 heartbeater.cc:511] Master 127.27.186.126:46751 requested a full tablet report, sending...
I20260811 16:45:07.170655 19972 ts_manager.cc:194] Registered new tserver with Master: 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291)
I20260811 16:45:07.171036 19972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:58283
I20260811 16:45:07.175894 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.169599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33288 (local address 127.27.186.126:46751)
0811 16:45:07.169644 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.169646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.169917 (+ 271us) server_negotiation.cc:407] Connection header received
0811 16:45:07.170004 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.170004 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.170028 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.170089 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:07.170720 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.171244 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.172014 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.172203 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.172272 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.173377 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:07.173379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:07.173379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:07.173386 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:07.174755 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:07.175105 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:07.175106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:07.175107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:07.175171 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:07.175381 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:07.175382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:07.175382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:07.175494 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:07.175686 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.175722 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.175796 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":26}
I20260811 16:45:07.176612 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:45:07.179116 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.176958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33298 (local address 127.27.186.126:46751)
0811 16:45:07.177021 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.177024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.177099 (+ 75us) server_negotiation.cc:407] Connection header received
0811 16:45:07.177167 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.177168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.177194 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.177242 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:45:07.177336 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.177825 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.178498 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.178669 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.178722 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.178851 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:45:07.178936 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:45:07.178992 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.179024 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.179037 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:45:07.179415 19972 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:45:07.181061 19972 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:45:07.183277 20188 tablet_service.cc:1467] Processing CreateTablet for tablet 62f4f50452b1402b83d93b655d3c6e9f (DEFAULT_TABLE table=test-table [id=65571014ed8247ffb190c828c1cf6bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:07.183531 20188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62f4f50452b1402b83d93b655d3c6e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:07.185094 20122 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Bootstrap starting.
I20260811 16:45:07.185418 20122 tablet_bootstrap.cc:654] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:07.186738 20779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.182940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52174 (local address 127.27.186.67:38291)
0811 16:45:07.183203 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.183208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.183237 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:45:07.183316 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.183318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.183336 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.183544 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:07.183683 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.184346 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.185771 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.186301 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.186363 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.186440 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.186607 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.186651 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":87,"threads_started":1}
I20260811 16:45:07.186721 20312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.182830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46105 (local address 127.0.0.1:51388)
0811 16:45:07.182879 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:07.182890 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:07.182928 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:07.183352 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:07.183353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:07.183355 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:07.183404 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.183406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.184651 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.184652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.185731 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.185733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.186425 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.186426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.186502 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.186530 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 16:45:07.186605 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:45:07.186651 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:45:07.186821 20122 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: No bootstrap required, opened a new log
I20260811 16:45:07.186828 20777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.182851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38291 (local address 127.0.0.1:52174)
0811 16:45:07.183176 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:07.183187 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:07.183249 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:07.183537 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:07.183538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:07.183539 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:07.183575 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.183576 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.184472 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.184473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.185666 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.185669 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.186394 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.186395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.186489 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.186515 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 16:45:07.186577 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:45:07.186729 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":77,"threads_started":1}
I20260811 16:45:07.186870 20122 ts_tablet_manager.cc:1397] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:45:07.187208 20781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.182957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51388 (local address 127.27.186.66:46105)
0811 16:45:07.183175 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.183180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.183191 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:45:07.183234 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.183236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.183253 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.183341 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:07.183464 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.184517 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.185813 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.186315 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.186411 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.186469 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.187078 (+ 609us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.187124 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":118,"threads_started":1}
I20260811 16:45:07.187271 20122 raft_consensus.cc:348] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.187357 20122 raft_consensus.cc:374] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:07.187402 20122 raft_consensus.cc:729] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44721e3377b048f185bf70fa0ba31ef9, State: Initialized, Role: FOLLOWER
I20260811 16:45:07.187456 20122 consensus_queue.cc:260] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.187553 20122 ts_tablet_manager.cc:1428] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:07.187641 20641 tablet_service.cc:1467] Processing CreateTablet for tablet 62f4f50452b1402b83d93b655d3c6e9f (DEFAULT_TABLE table=test-table [id=65571014ed8247ffb190c828c1cf6bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:07.187870 20413 tablet_service.cc:1467] Processing CreateTablet for tablet 62f4f50452b1402b83d93b655d3c6e9f (DEFAULT_TABLE table=test-table [id=65571014ed8247ffb190c828c1cf6bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:07.187999 20641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62f4f50452b1402b83d93b655d3c6e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:07.188196 20413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62f4f50452b1402b83d93b655d3c6e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:07.191138 20783 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Bootstrap starting.
I20260811 16:45:07.191313 20784 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Bootstrap starting.
I20260811 16:45:07.191780 20783 tablet_bootstrap.cc:654] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:07.191955 20784 tablet_bootstrap.cc:654] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:07.192426 20783 log.cc:824] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:07.192657 20784 log.cc:824] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:07.193207 20783 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: No bootstrap required, opened a new log
I20260811 16:45:07.193295 20783 ts_tablet_manager.cc:1397] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:07.193431 20784 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: No bootstrap required, opened a new log
I20260811 16:45:07.193550 20784 ts_tablet_manager.cc:1397] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:07.194736 20783 raft_consensus.cc:348] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.194906 20783 raft_consensus.cc:374] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:07.194970 20783 raft_consensus.cc:729] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e12a7fd2f1f468a85dc9ea558c62a60, State: Initialized, Role: FOLLOWER
I20260811 16:45:07.195032 20784 raft_consensus.cc:348] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.195192 20784 raft_consensus.cc:374] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:07.195140 20783 consensus_queue.cc:260] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.195227 20784 raft_consensus.cc:729] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f5e0ce24627423ca212d1d9413a9bad, State: Initialized, Role: FOLLOWER
I20260811 16:45:07.195336 20784 consensus_queue.cc:260] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.195464 20783 ts_tablet_manager.cc:1428] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:07.195482 20767 heartbeater.cc:503] Master 127.27.186.126:46751 was elected leader, sending a full tablet report...
I20260811 16:45:07.195636 20784 ts_tablet_manager.cc:1428] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:07.195690 20528 heartbeater.cc:503] Master 127.27.186.126:46751 was elected leader, sending a full tablet report...
W20260811 16:45:07.252511 20533 tablet.cc:2369] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:45:07.362213 20292 tablet.cc:2369] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:45:07.410125 20769 tablet.cc:2369] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:45:07.567546 20795 raft_consensus.cc:482] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:07.567687 20795 raft_consensus.cc:504] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.568143 20795 leader_election.cc:288] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291), 44721e3377b048f185bf70fa0ba31ef9 (127.27.186.65:39013)
I20260811 16:45:07.571206 20779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.568449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:44613 (local address 127.27.186.67:38291)
0811 16:45:07.568551 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.568554 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.568565 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:45:07.568655 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.568657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.568666 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.568736 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:07.568901 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.569382 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.570455 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.570842 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.570933 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.570943 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.571105 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.571143 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 16:45:07.571326 20797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.568534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:39013 (local address 127.27.186.66:57051)
0811 16:45:07.568653 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:07.568665 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:07.568721 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:07.568917 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:07.568918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:07.568920 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:07.569009 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.569011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.569703 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.569704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.570466 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.570468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.571051 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.571052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.571120 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.571124 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:45:07.571185 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 16:45:07.571226 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":50,"threads_started":1}
I20260811 16:45:07.571312 20798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.568626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:57051 (local address 127.27.186.65:39013)
0811 16:45:07.568753 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.568755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.568764 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:45:07.568801 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.568802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.568825 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.568915 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:07.569089 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.569621 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.570559 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.570960 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.571052 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.571128 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.571193 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.571236 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260811 16:45:07.571220 20796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.568319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38291 (local address 127.27.186.66:44613)
0811 16:45:07.568466 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:07.568477 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:07.568581 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:07.568741 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:07.568742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:07.568745 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:07.568825 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.568827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.569501 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.569503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.570365 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:07.570367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.570942 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.570943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:07.571017 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.571020 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:45:07.571086 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:45:07.571126 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
I20260811 16:45:07.571810 20223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f4f50452b1402b83d93b655d3c6e9f" candidate_uuid: "1f5e0ce24627423ca212d1d9413a9bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44721e3377b048f185bf70fa0ba31ef9" is_pre_election: true
I20260811 16:45:07.571878 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f4f50452b1402b83d93b655d3c6e9f" candidate_uuid: "1f5e0ce24627423ca212d1d9413a9bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" is_pre_election: true
I20260811 16:45:07.572006 20678 raft_consensus.cc:2454] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f5e0ce24627423ca212d1d9413a9bad in term 0.
I20260811 16:45:07.572005 20223 raft_consensus.cc:2454] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f5e0ce24627423ca212d1d9413a9bad in term 0.
I20260811 16:45:07.572237 20342 leader_election.cc:302] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f5e0ce24627423ca212d1d9413a9bad, 44721e3377b048f185bf70fa0ba31ef9; no voters:
I20260811 16:45:07.572367 20795 raft_consensus.cc:2781] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:45:07.572424 20795 raft_consensus.cc:482] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:45:07.572450 20795 raft_consensus.cc:3037] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:07.573238 20795 raft_consensus.cc:504] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.573372 20795 leader_election.cc:288] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [CANDIDATE]: Term 1 election: Requested vote from peers 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291), 44721e3377b048f185bf70fa0ba31ef9 (127.27.186.65:39013)
I20260811 16:45:07.573591 20223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f4f50452b1402b83d93b655d3c6e9f" candidate_uuid: "1f5e0ce24627423ca212d1d9413a9bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44721e3377b048f185bf70fa0ba31ef9"
I20260811 16:45:07.573591 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f4f50452b1402b83d93b655d3c6e9f" candidate_uuid: "1f5e0ce24627423ca212d1d9413a9bad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60"
I20260811 16:45:07.573675 20223 raft_consensus.cc:3037] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:07.573675 20678 raft_consensus.cc:3037] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:07.574568 20223 raft_consensus.cc:2454] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f5e0ce24627423ca212d1d9413a9bad in term 1.
I20260811 16:45:07.574568 20678 raft_consensus.cc:2454] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f5e0ce24627423ca212d1d9413a9bad in term 1.
I20260811 16:45:07.574739 20342 leader_election.cc:302] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f5e0ce24627423ca212d1d9413a9bad, 44721e3377b048f185bf70fa0ba31ef9; no voters:
I20260811 16:45:07.574831 20795 raft_consensus.cc:2781] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:45:07.575060 20795 raft_consensus.cc:686] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 1 LEADER]: Becoming Leader. State: Replica: 1f5e0ce24627423ca212d1d9413a9bad, State: Running, Role: LEADER
I20260811 16:45:07.575189 20795 consensus_queue.cc:237] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.576082 19968 catalog_manager.cc:5495] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66). New cstate: current_term: 1 leader_uuid: "1f5e0ce24627423ca212d1d9413a9bad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } health_report { overall_health: UNKNOWN } } }
I20260811 16:45:07.631470 20781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.628821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51398 (local address 127.27.186.66:46105)
0811 16:45:07.628887 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:07.628889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:07.628898 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:45:07.628978 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:07.628979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:07.629011 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:07.629090 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:45:07.629208 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.629838 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.630663 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:07.630867 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:07.630958 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:07.631134 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:45:07.631245 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:45:07.631340 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:07.631360 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 16:45:07.631382 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 16:45:07.633423 20223 raft_consensus.cc:1261] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Refusing update from remote peer 1f5e0ce24627423ca212d1d9413a9bad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:07.633423 20678 raft_consensus.cc:1261] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 1 FOLLOWER]: Refusing update from remote peer 1f5e0ce24627423ca212d1d9413a9bad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:07.633808 20800 consensus_queue.cc:1035] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:07.633948 20795 consensus_queue.cc:1035] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [LEADER]: Connected to new peer: Peer: permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:07.635851 20805 mvcc.cc:205] Tried to move back new op lower bound from 7317367634463502336 to 7317367634228543488. Current Snapshot: MvccSnapshot[applied={T|T < 7317367634463502336}]
I20260811 16:45:07.636075 20806 mvcc.cc:205] Tried to move back new op lower bound from 7317367634463502336 to 7317367634228543488. Current Snapshot: MvccSnapshot[applied={T|T < 7317367634463502336}]
I20260811 16:45:07.638511 19968 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:45:07.638609 19968 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:45:07.639354 19968 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Sending DeleteTablet for 3 replicas of tablet 62f4f50452b1402b83d93b655d3c6e9f
I20260811 16:45:07.639657 20413 tablet_service.cc:1514] Processing DeleteTablet for tablet 62f4f50452b1402b83d93b655d3c6e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:07 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:51388
I20260811 16:45:07.639684 20188 tablet_service.cc:1514] Processing DeleteTablet for tablet 62f4f50452b1402b83d93b655d3c6e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:07 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:44672
I20260811 16:45:07.639729 20641 tablet_service.cc:1514] Processing DeleteTablet for tablet 62f4f50452b1402b83d93b655d3c6e9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:07 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:52174
I20260811 16:45:07.639890 20820 tablet_replica.cc:330] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: stopping tablet replica
I20260811 16:45:07.639990 20820 raft_consensus.cc:2229] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:07.639995 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 20039
I20260811 16:45:07.640059 20818 tablet_replica.cc:330] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: stopping tablet replica
I20260811 16:45:07.652012 20818 raft_consensus.cc:2229] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:45:07.652251 20818 raft_consensus.cc:2258] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:07.652823 20818 ts_tablet_manager.cc:1905] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:07.654855 20818 ts_tablet_manager.cc:1918] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:07.654989 20818 log.cc:1196] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/62f4f50452b1402b83d93b655d3c6e9f
I20260811 16:45:07.655123 20823 tablet_replica.cc:330] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: stopping tablet replica
I20260811 16:45:07.655335 20823 raft_consensus.cc:2229] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:07.655405 20818 ts_tablet_manager.cc:1939] T 62f4f50452b1402b83d93b655d3c6e9f P 1f5e0ce24627423ca212d1d9413a9bad: Deleting consensus metadata
I20260811 16:45:07.655536 20823 raft_consensus.cc:2258] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:07.655993 19944 catalog_manager.cc:4841] TS 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105): tablet 62f4f50452b1402b83d93b655d3c6e9f (table test-table [id=65571014ed8247ffb190c828c1cf6bcb]) successfully deleted
I20260811 16:45:07.656064 20823 ts_tablet_manager.cc:1905] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:07.658071 20823 ts_tablet_manager.cc:1918] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:07.658156 20823 log.cc:1196] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/62f4f50452b1402b83d93b655d3c6e9f
I20260811 16:45:07.658460 20823 ts_tablet_manager.cc:1939] T 62f4f50452b1402b83d93b655d3c6e9f P 2e12a7fd2f1f468a85dc9ea558c62a60: Deleting consensus metadata
I20260811 16:45:07.658942 19942 catalog_manager.cc:4841] TS 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291): tablet 62f4f50452b1402b83d93b655d3c6e9f (table test-table [id=65571014ed8247ffb190c828c1cf6bcb]) successfully deleted
W20260811 16:45:07.659780 19942 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:39013 (error 108)
I20260811 16:45:07.660337 20777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:07.660193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:39013 (local address 127.0.0.1:44678)
0811 16:45:07.660251 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:07.660300 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:45:07.660633 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 20296
W20260811 16:45:07.660466 19942 catalog_manager.cc:4584] TS 44721e3377b048f185bf70fa0ba31ef9 (127.27.186.65:39013): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 62f4f50452b1402b83d93b655d3c6e9f: Network error: Client connection negotiation failed: client connection to 127.27.186.65:39013: connect: Connection refused (error 111)
I20260811 16:45:07.670827 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 20535
I20260811 16:45:07.680601 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 19912
I20260811 16:45:07.691613 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:46751
--webserver_interface=127.27.186.126
--webserver_port=33921
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:46751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:07.774436 20827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:07.774636 20827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:07.774659 20827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:07.775805 20827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:07.775846 20827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:07.775861 20827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:07.775873 20827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:07.775928 20827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:07.777541 20827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:46751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:46751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=33921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:07.777801 20827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:07.778050 20827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:07.782886 20840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:07.782876 20835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:07.783142 20827 server_base.cc:1034] running on GCE node
W20260811 16:45:07.782894 20838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:07.783562 20827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:07.783818 20827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:07.784965 20827 hybrid_clock.cc:648] HybridClock initialized: now 1786466707784951 us; error 30 us; skew 500 ppm
Aug 11 16:45:07 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466707, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:07.787580 20827 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:45:07.788034 20827 webserver.cc:460] Webserver started at http://127.27.186.126:33921/ using document root <none> and password file <none>
I20260811 16:45:07.788282 20827 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:07.788331 20827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:07.789714 20827 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:07.790445 20847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:07.790653 20827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:07.790751 20827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "640b97e66bc54730831324e1526e9a9c"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "999231813b4c871174301c3113fa68a0"
server_key_iv: "570bb8990c856642d8ff00a093d72216"
server_key_version: "encryptionkey@0"
I20260811 16:45:07.791110 20827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:07.801399 20827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:07.803850 20827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:07.804004 20827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:07.808085 20827 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:46751
I20260811 16:45:07.808164 20952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:46751 every 8 connection(s)
I20260811 16:45:07.808538 20827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:45:07.810253 20953 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:45:07.810925 20953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Bootstrap starting.
I20260811 16:45:07.817324 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 20827
I20260811 16:45:07.817677 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:39013
--local_ip_for_outbound_sockets=127.27.186.65
--tserver_master_addrs=127.27.186.126:46751
--webserver_port=32945
--webserver_interface=127.27.186.65
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:07.820592 20953 log.cc:824] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:07.823006 20953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:45:07.823298 20953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c: Bootstrap complete.
I20260811 16:45:07.825685 20953 raft_consensus.cc:348] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:07.825912 20953 raft_consensus.cc:729] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 640b97e66bc54730831324e1526e9a9c, State: Initialized, Role: FOLLOWER
I20260811 16:45:07.826087 20953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:07.826151 20953 raft_consensus.cc:388] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:45:07.826210 20953 raft_consensus.cc:482] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:45:07.826258 20953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:45:07.827271 20953 raft_consensus.cc:504] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:07.827360 20953 leader_election.cc:302] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 640b97e66bc54730831324e1526e9a9c; no voters:
I20260811 16:45:07.827598 20953 leader_election.cc:288] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 16:45:07.827633 20961 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:45:07.827751 20961 raft_consensus.cc:686] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [term 3 LEADER]: Becoming Leader. State: Replica: 640b97e66bc54730831324e1526e9a9c, State: Running, Role: LEADER
I20260811 16:45:07.827848 20961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } }
I20260811 16:45:07.827884 20953 sys_catalog.cc:564] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:07.829566 20964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 640b97e66bc54730831324e1526e9a9c. Latest consensus state: current_term: 3 leader_uuid: "640b97e66bc54730831324e1526e9a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } } }
I20260811 16:45:07.829727 20964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:07.829926 20989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:45:07.830256 20962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "640b97e66bc54730831324e1526e9a9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "640b97e66bc54730831324e1526e9a9c" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 46751 } } }
I20260811 16:45:07.830327 20962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 640b97e66bc54730831324e1526e9a9c [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:07.831246 20989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:45:07.831385 20989 catalog_manager.cc:1259] Loaded cluster ID: 2be82947a4104a319cad070456cbc62e
I20260811 16:45:07.831427 20989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 16:45:07.831748 20989 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff800ab89ad google::LogMessage::Fail() at ??:0
@ 0x7ff800abb88a google::LogMessage::SendToLog() at ??:0
@ 0x7ff800ab84de google::LogMessage::Flush() at ??:0
@ 0x7ff800ab9a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff8089d90f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7ff8089e28b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff8029860d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff80297b954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff8037df6db start_thread at ??:0
@ 0x7ff7ff5b661f clone at ??:0
W20260811 16:45:07.919135 20955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:07.919333 20955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:07.919356 20955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:07.920552 20955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:07.920593 20955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:07.920619 20955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:45:07.922087 20955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:39013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=32945
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:07.922338 20955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:07.922586 20955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:07.928838 21019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:07.928762 21022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:07.928776 21018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:07.929109 20955 server_base.cc:1034] running on GCE node
I20260811 16:45:07.929404 20955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:07.929689 20955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:07.930860 20955 hybrid_clock.cc:648] HybridClock initialized: now 1786466707930847 us; error 32 us; skew 500 ppm
Aug 11 16:45:07 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466707, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:07.933539 20955 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:45:07.934065 20955 webserver.cc:460] Webserver started at http://127.27.186.65:32945/ using document root <none> and password file <none>
I20260811 16:45:07.934283 20955 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:07.934355 20955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:07.935714 20955 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:07.936424 21037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:07.936614 20955 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:07.936705 20955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "44721e3377b048f185bf70fa0ba31ef9"
format_stamp: "Formatted at 2026-08-11 16:45:05 on dist-test-slave-gsp7"
server_key: "ac2ded5705016a941b5759767c9eb60f"
server_key_iv: "48b6c101f8be9f6a1a02e851e9923a00"
server_key_version: "encryptionkey@0"
I20260811 16:45:07.937059 20955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:07.957183 20955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:07.959429 20955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:07.959589 20955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:07.959872 20955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:07.960367 21045 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:45:07.961956 20955 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:45:07.962011 20955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:45:07.962038 20955 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:45:07.962778 20955 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:45:07.962824 20955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:45:07.962884 21045 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Bootstrap starting.
I20260811 16:45:07.971047 20955 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:39013
I20260811 16:45:07.971562 20955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:45:07.972151 21231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:39013 every 8 connection(s)
I20260811 16:45:07.974436 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 20955
I20260811 16:45:07.974745 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:46105
--local_ip_for_outbound_sockets=127.27.186.66
--tserver_master_addrs=127.27.186.126:46751
--webserver_port=38885
--webserver_interface=127.27.186.66
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:07.975431 21045 log.cc:824] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:07.978252 21045 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:45:07.978564 21045 tablet_bootstrap.cc:492] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Bootstrap complete.
I20260811 16:45:07.979930 21045 ts_tablet_manager.cc:1397] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.011s
I20260811 16:45:07.981918 21045 raft_consensus.cc:348] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.982339 21045 raft_consensus.cc:729] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44721e3377b048f185bf70fa0ba31ef9, State: Initialized, Role: FOLLOWER
I20260811 16:45:07.982533 21045 consensus_queue.cc:260] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:07.982852 21045 ts_tablet_manager.cc:1428] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
W20260811 16:45:08.024145 21237 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:45:07.972296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:40065)
0811 16:45:07.972640 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:07.972689 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:07.973300 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:08.023908 (+ 50608us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":105,"threads_started":1}
W20260811 16:45:08.024453 21233 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:46751 (0 consecutive failures): Network error: Failed to ping master at 127.27.186.126:46751: Client connection negotiation failed: client connection to 127.27.186.126:46751: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:45:08.024818 21237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:08.024698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:47697)
0811 16:45:08.024751 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:08.024797 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:45:08.025202 21237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:08.025115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:36117)
0811 16:45:08.025162 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:08.025186 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 16:45:08.025332 21233 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:45:08.062551 21241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:08.062767 21241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:08.062793 21241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:08.063956 21241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:08.064000 21241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:08.064026 21241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:45:08.065524 21241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:46105
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=38885
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:08.065755 21241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:08.065980 21241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:08.071398 21252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:08.071411 21257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:08.071411 21255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:08.071456 21241 server_base.cc:1034] running on GCE node
I20260811 16:45:08.071877 21241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:08.072160 21241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:08.073307 21241 hybrid_clock.cc:648] HybridClock initialized: now 1786466708073297 us; error 28 us; skew 500 ppm
Aug 11 16:45:08 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466708, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:08.075951 21241 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:45:08.076404 21241 webserver.cc:460] Webserver started at http://127.27.186.66:38885/ using document root <none> and password file <none>
I20260811 16:45:08.076654 21241 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:08.076702 21241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:08.078331 21241 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:45:08.078969 21270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:08.079149 21241 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:45:08.079245 21241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "1f5e0ce24627423ca212d1d9413a9bad"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "ce986070443022f5e28fd125409dd5f8"
server_key_iv: "3769a105a995fcc3a0e7c0404b9dd0c8"
server_key_version: "encryptionkey@0"
I20260811 16:45:08.079620 21241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:08.089803 21241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:08.091598 21241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:08.091763 21241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:08.091992 21241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:08.092305 21241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:08.092360 21241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:08.092394 21241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:08.092422 21241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:08.098667 21241 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:46105
I20260811 16:45:08.098716 21467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:46105 every 8 connection(s)
I20260811 16:45:08.099066 21241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:45:08.100137 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:08.099754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:46367)
0811 16:45:08.099913 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:08.100001 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
W20260811 16:45:08.100587 21468 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:46751 (0 consecutive failures): Network error: Failed to ping master at 127.27.186.126:46751: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
I20260811 16:45:08.100864 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:08.100774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:42181)
0811 16:45:08.100819 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:08.100846 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 16:45:08.101145 21470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:08.101066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:57535)
0811 16:45:08.101102 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:08.101131 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260811 16:45:08.101259 21468 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:45:08.101640 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 21241
I20260811 16:45:08.101899 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:38291
--local_ip_for_outbound_sockets=127.27.186.67
--tserver_master_addrs=127.27.186.126:46751
--webserver_port=34811
--webserver_interface=127.27.186.67
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:42115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:08.186278 21471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:08.186491 21471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:08.186517 21471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:08.187660 21471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:08.187703 21471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:08.187752 21471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:45:08.189188 21471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:42115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:38291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=34811
--tserver_master_addrs=127.27.186.126:46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:08.189394 21471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:08.189644 21471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:08.194706 21479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:08.194710 21471 server_base.cc:1034] running on GCE node
W20260811 16:45:08.194722 21482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:08.194716 21478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:08.195139 21471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:08.195405 21471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:08.196547 21471 hybrid_clock.cc:648] HybridClock initialized: now 1786466708196536 us; error 30 us; skew 500 ppm
Aug 11 16:45:08 dist-test-slave-gsp7 krb5kdc[18971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466708, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:08.199143 21471 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:45:08.199643 21471 webserver.cc:460] Webserver started at http://127.27.186.67:34811/ using document root <none> and password file <none>
I20260811 16:45:08.199887 21471 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:08.199957 21471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:08.201299 21471 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:45:08.202001 21497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:08.202173 21471 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:08.202263 21471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "2e12a7fd2f1f468a85dc9ea558c62a60"
format_stamp: "Formatted at 2026-08-11 16:45:06 on dist-test-slave-gsp7"
server_key: "e54cde9205a65d9e07167bc72ad00c12"
server_key_iv: "1a48c8667958628bb73f2a58540742bb"
server_key_version: "encryptionkey@0"
I20260811 16:45:08.202623 21471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:08.221707 21471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:08.223801 21471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:08.223979 21471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:08.224241 21471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:08.224573 21471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:08.224630 21471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:08.224671 21471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:08.224714 21471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:08.230880 21471 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:38291
I20260811 16:45:08.230937 21695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:38291 every 8 connection(s)
I20260811 16:45:08.231278 21471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:45:08.232471 21698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:08.232061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:52339)
0811 16:45:08.232243 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:08.232325 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":85,"threads_started":1}
W20260811 16:45:08.232887 21696 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:46751 (0 consecutive failures): Network error: Failed to ping master at 127.27.186.126:46751: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
I20260811 16:45:08.233174 21698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:08.233071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:47733)
0811 16:45:08.233121 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:08.233146 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:45:08.233448 21698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:08.233362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:55303)
0811 16:45:08.233405 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:08.233427 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 16:45:08.233587 21696 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:45:08.237768 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 21471
I20260811 16:45:09.026032 21700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:09.025745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:39143)
0811 16:45:09.025906 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:09.025946 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":82,"threads_started":1}
I20260811 16:45:09.101799 21701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:09.101585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:52015)
0811 16:45:09.101706 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:09.101743 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":58,"threads_started":1}
I20260811 16:45:09.234228 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:09.233978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:34239)
0811 16:45:09.234131 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:09.234173 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260811 16:45:09.243122 21703 raft_consensus.cc:482] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:09.243252 21703 raft_consensus.cc:504] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:09.243676 21703 leader_election.cc:288] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105), 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291)
Aug 11 16:45:09 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466707, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.67@KRBTEST.COM
Aug 11 16:45:09 dist-test-slave-gsp7 krb5kdc[18971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466707, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.66@KRBTEST.COM
I20260811 16:45:09.254515 21709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:09.243980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:57911 (local address 127.27.186.67:38291)
0811 16:45:09.244163 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:09.244176 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:09.244214 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:45:09.244700 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:09.244703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:09.244743 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:09.244896 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:09.245695 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:09.246536 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:09.247525 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:09.247927 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:09.248043 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:09.250572 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:09.250582 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:09.250582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:09.250592 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:09.252777 (+ 2185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:09.253188 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:09.253191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:09.253191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:09.253279 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:09.253599 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:09.253600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:09.253600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:09.253855 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:09.253946 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:09.254264 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 16:45:09.254392 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":69,"threads_started":1}
I20260811 16:45:09.254496 21705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:09.243852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:38291 (local address 127.27.186.65:57911)
0811 16:45:09.243997 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:09.244007 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:09.244082 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:09.244937 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:09.244939 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:09.245313 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:09.245567 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:09.245574 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:09.246645 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:09.246646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:09.247437 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:09.247438 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:09.248023 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:09.248024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:09.248135 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:09.248796 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:09.248806 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:09.250448 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:09.252878 (+ 2430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:09.252885 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:09.252887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:09.253108 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:09.253360 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:09.253361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:09.253362 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:09.253518 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:09.253941 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:09.253948 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:09.254090 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 16:45:09.254193 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 16:45:09.254385 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":30,"thread_start_us":87,"threads_started":1}
I20260811 16:45:09.254604 21707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:09.243961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:41665 (local address 127.27.186.66:46105)
0811 16:45:09.244195 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:09.244204 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:09.244230 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:45:09.244699 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:09.244700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:09.244743 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:09.244896 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:09.245689 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:09.246544 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:09.247564 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:09.247942 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:09.248075 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:09.250924 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:09.250928 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:09.250929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:09.250941 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:09.252777 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:09.253440 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:09.253444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:09.253444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:09.253590 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:09.253804 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:09.253805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:09.253806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:09.254058 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:09.254149 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:09.254363 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 16:45:09.254493 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":71,"threads_started":1}
I20260811 16:45:09.254612 21700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:09.243845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:46105 (local address 127.27.186.65:41665)
0811 16:45:09.243904 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:09.243916 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:09.244164 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:09.244936 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:09.244939 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:09.245313 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:09.245567 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:09.245574 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:09.246674 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:09.246675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:09.247438 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:09.247441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:09.248051 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:09.248052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:09.248135 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:09.248744 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:09.248762 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:09.250818 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:09.253187 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:09.253187 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:09.253188 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:09.253327 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:09.253665 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:09.253666 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:09.253667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:09.253735 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:09.254143 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:09.254144 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:09.254197 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 16:45:09.254285 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 16:45:09.254477 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":115}
W20260811 16:45:09.255327 21041 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
W20260811 16:45:09.255775 21040 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
I20260811 16:45:09.255836 21040 leader_election.cc:302] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44721e3377b048f185bf70fa0ba31ef9; no voters: 1f5e0ce24627423ca212d1d9413a9bad, 2e12a7fd2f1f468a85dc9ea558c62a60
I20260811 16:45:09.255975 21703 raft_consensus.cc:2726] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:45:10.026997 21713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:10.026722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:49947)
0811 16:45:10.026898 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:10.026946 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":76,"threads_started":1}
I20260811 16:45:10.102496 21715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:10.102287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:40209)
0811 16:45:10.102409 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:10.102449 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260811 16:45:10.234978 21716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:10.234747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:42415)
0811 16:45:10.234887 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:10.234932 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260811 16:45:11.027802 21717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:11.027575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:47105)
0811 16:45:11.027712 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:11.027752 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260811 16:45:11.103333 21718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:11.103089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:51247)
0811 16:45:11.103242 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:11.103287 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
I20260811 16:45:11.223862 21719 raft_consensus.cc:482] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:11.223984 21719 raft_consensus.cc:504] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:11.224203 21719 leader_election.cc:288] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105), 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291)
W20260811 16:45:11.224632 21041 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
W20260811 16:45:11.224716 21040 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
I20260811 16:45:11.224834 21040 leader_election.cc:302] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44721e3377b048f185bf70fa0ba31ef9; no voters: 1f5e0ce24627423ca212d1d9413a9bad, 2e12a7fd2f1f468a85dc9ea558c62a60
I20260811 16:45:11.224923 21719 raft_consensus.cc:2726] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:45:11.235715 21723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:11.235519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:52299)
0811 16:45:11.235639 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:11.235672 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260811 16:45:12.028623 21724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:12.028360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:47159)
0811 16:45:12.028530 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:12.028573 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":98,"threads_started":1}
I20260811 16:45:12.104228 21725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:12.103847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:54507)
0811 16:45:12.104103 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:12.104159 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260811 16:45:12.236408 21727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:12.236177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:33023)
0811 16:45:12.236321 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:12.236365 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":82,"threads_started":1}
I20260811 16:45:13.029446 21728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:13.029180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:52953)
0811 16:45:13.029355 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:13.029399 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":72,"threads_started":1}
I20260811 16:45:13.105072 21729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:13.104774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:35205)
0811 16:45:13.104972 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:13.105022 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":111,"threads_started":1}
I20260811 16:45:13.237211 21730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:13.236955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:55849)
0811 16:45:13.237122 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:13.237164 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":78,"threads_started":1}
I20260811 16:45:13.411273 21735 raft_consensus.cc:482] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:13.411402 21735 raft_consensus.cc:504] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:13.411645 21735 leader_election.cc:288] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105), 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291)
W20260811 16:45:13.412139 21041 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
W20260811 16:45:13.412235 21040 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
I20260811 16:45:13.412335 21040 leader_election.cc:302] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44721e3377b048f185bf70fa0ba31ef9; no voters: 1f5e0ce24627423ca212d1d9413a9bad, 2e12a7fd2f1f468a85dc9ea558c62a60
I20260811 16:45:13.412411 21735 raft_consensus.cc:2726] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:45:14.030256 21737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:14.029983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:37781)
0811 16:45:14.030165 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:14.030206 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":81,"threads_started":1}
I20260811 16:45:14.105875 21739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:14.105650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:51243)
0811 16:45:14.105786 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:14.105829 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":64,"threads_started":1}
I20260811 16:45:14.237980 21742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:14.237755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:43961)
0811 16:45:14.237897 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:14.237933 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260811 16:45:15.031051 21745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:15.030804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:47803)
0811 16:45:15.030959 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:15.031000 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":102,"threads_started":1}
I20260811 16:45:15.106585 21746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:15.106321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:39645)
0811 16:45:15.106500 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:15.106541 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":81,"threads_started":1}
I20260811 16:45:15.238734 21747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:15.238478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:34461)
0811 16:45:15.238645 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:15.238688 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260811 16:45:16.031807 21750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:16.031585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:44521)
0811 16:45:16.031717 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:16.031756 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260811 16:45:16.107254 21751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:16.107025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:35681)
0811 16:45:16.107171 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:16.107212 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":64,"threads_started":1}
I20260811 16:45:16.114337 21752 raft_consensus.cc:482] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:16.114427 21752 raft_consensus.cc:504] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:16.114651 21752 leader_election.cc:288] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105), 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291)
W20260811 16:45:16.115061 21041 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
W20260811 16:45:16.115140 21040 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
I20260811 16:45:16.115204 21040 leader_election.cc:302] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44721e3377b048f185bf70fa0ba31ef9; no voters: 1f5e0ce24627423ca212d1d9413a9bad, 2e12a7fd2f1f468a85dc9ea558c62a60
I20260811 16:45:16.115294 21752 raft_consensus.cc:2726] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:45:16.239514 21753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:16.239238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:48527)
0811 16:45:16.239388 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:16.239447 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260811 16:45:17.032748 21754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:17.032478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:48921)
0811 16:45:17.032646 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:17.032692 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":69,"threads_started":1}
I20260811 16:45:17.107923 21755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:17.107703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:37189)
0811 16:45:17.107834 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:17.107875 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260811 16:45:17.240342 21756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:17.240077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:54913)
0811 16:45:17.240236 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:17.240290 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":79,"threads_started":1}
I20260811 16:45:18.033680 21759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:18.033373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:50269)
0811 16:45:18.033587 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:18.033631 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":91,"threads_started":1}
I20260811 16:45:18.108738 21760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:18.108466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:47801)
0811 16:45:18.108631 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:18.108687 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":82,"threads_started":1}
I20260811 16:45:18.241101 21761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:18.240859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:47507)
0811 16:45:18.241015 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:18.241051 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260811 16:45:18.685191 21762 raft_consensus.cc:482] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:18.685289 21762 raft_consensus.cc:504] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f5e0ce24627423ca212d1d9413a9bad" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 46105 } } peers { permanent_uuid: "2e12a7fd2f1f468a85dc9ea558c62a60" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 38291 } } peers { permanent_uuid: "44721e3377b048f185bf70fa0ba31ef9" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 39013 } }
I20260811 16:45:18.685547 21762 leader_election.cc:288] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105), 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291)
W20260811 16:45:18.685954 21041 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1f5e0ce24627423ca212d1d9413a9bad (127.27.186.66:46105): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
W20260811 16:45:18.686080 21040 leader_election.cc:341] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2e12a7fd2f1f468a85dc9ea558c62a60 (127.27.186.67:38291): Not found: Tablet not found: 62f4f50452b1402b83d93b655d3c6e9f
I20260811 16:45:18.686163 21040 leader_election.cc:302] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44721e3377b048f185bf70fa0ba31ef9; no voters: 1f5e0ce24627423ca212d1d9413a9bad, 2e12a7fd2f1f468a85dc9ea558c62a60
I20260811 16:45:18.686255 21762 raft_consensus.cc:2726] T 62f4f50452b1402b83d93b655d3c6e9f P 44721e3377b048f185bf70fa0ba31ef9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:45:19.034469 21763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:19.034203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:39445)
0811 16:45:19.034376 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:19.034419 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":76,"threads_started":1}
I20260811 16:45:19.109640 21765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:19.109282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:43065)
0811 16:45:19.109448 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:19.109564 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":81,"threads_started":1}
I20260811 16:45:19.241932 21766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:19.241691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:52817)
0811 16:45:19.241835 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:19.241880 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
I20260811 16:45:20.035348 21772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:20.035088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:43125)
0811 16:45:20.035251 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:20.035297 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":75,"threads_started":1}
I20260811 16:45:20.110469 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:20.110194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:39369)
0811 16:45:20.110351 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:20.110396 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":68,"threads_started":1}
I20260811 16:45:20.242702 21774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:20.242454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:40541)
0811 16:45:20.242598 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:20.242642 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
I20260811 16:45:21.036108 21775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:21.035874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:35191)
0811 16:45:21.036015 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:21.036057 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260811 16:45:21.111212 21779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:21.110978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:59537)
0811 16:45:21.111124 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:21.111161 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":69,"threads_started":1}
I20260811 16:45:21.243574 21780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:21.243278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:50719)
0811 16:45:21.243455 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:21.243506 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":113,"threads_started":1}
I20260811 16:45:22.036989 21781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:22.036677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:44167)
0811 16:45:22.036852 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:22.036900 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":78,"threads_started":1}
I20260811 16:45:22.111979 21782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:22.111733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:58445)
0811 16:45:22.111881 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:22.111926 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
I20260811 16:45:22.244262 21783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:22.244044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:43181)
0811 16:45:22.244174 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:22.244212 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260811 16:45:23.037957 21784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:23.037702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.65:43003)
0811 16:45:23.037870 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:23.037910 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":117,"threads_started":1}
I20260811 16:45:23.112839 21785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:23.112552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.66:60465)
0811 16:45:23.112750 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:23.112790 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":63,"threads_started":1}
I20260811 16:45:23.238484 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 20955
I20260811 16:45:23.248207 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:23.246219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:46751 (local address 127.27.186.67:46377)
0811 16:45:23.248103 (+ 1884us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:23.248144 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:46751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1863,"thread_start_us":857,"threads_started":1}
I20260811 16:45:23.275548 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 21241
I20260811 16:45:23.286715 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 21471
2026-08-11T16:45:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19092 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:45:23 dist-test-slave-gsp7 krb5kdc[21790](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:45:23 dist-test-slave-gsp7 krb5kdc[21790](info): set up 2 sockets
Aug 11 16:45:23 dist-test-slave-gsp7 krb5kdc[21790](info): commencing operation
krb5kdc: starting...
W20260811 16:45:24.554065 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:45:24 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:45:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:45:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:45:24.682543 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39941
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:39941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:24.769655 21812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:24.769913 21812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:24.769953 21812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:24.771121 21812 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:45:24.771191 21812 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:45:24.771214 21812 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:45:24.771230 21812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:24.771253 21812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:24.771283 21812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:24.771309 21812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:24.771337 21812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:24.772868 21812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:39941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:24.773162 21812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:24.773406 21812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:24.778873 21821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:24.778861 21820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:24.778846 21824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:24.778891 21812 server_base.cc:1034] running on GCE node
I20260811 16:45:24.779366 21812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:24.779666 21812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:24.780840 21812 hybrid_clock.cc:648] HybridClock initialized: now 1786466724780821 us; error 35 us; skew 500 ppm
Aug 11 16:45:24 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466724, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:24.787300 21812 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:45:24.787846 21812 webserver.cc:460] Webserver started at http://127.27.186.126:35719/ using document root <none> and password file <none>
I20260811 16:45:24.788103 21812 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:24.788174 21812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:24.788327 21812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:24.789418 21812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "448cc46df3ad44148517ac98346953e6"
format_stamp: "Formatted at 2026-08-11 16:45:24 on dist-test-slave-gsp7"
server_key: "3247707deca032568f49c5866500911f"
server_key_iv: "2d955ed3080b7d53d44435ad204df834"
server_key_version: "encryptionkey@0"
I20260811 16:45:24.789868 21812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "448cc46df3ad44148517ac98346953e6"
format_stamp: "Formatted at 2026-08-11 16:45:24 on dist-test-slave-gsp7"
server_key: "3247707deca032568f49c5866500911f"
server_key_iv: "2d955ed3080b7d53d44435ad204df834"
server_key_version: "encryptionkey@0"
I20260811 16:45:24.791288 21812 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:24.792081 21840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:24.792259 21812 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:45:24.792371 21812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "448cc46df3ad44148517ac98346953e6"
format_stamp: "Formatted at 2026-08-11 16:45:24 on dist-test-slave-gsp7"
server_key: "3247707deca032568f49c5866500911f"
server_key_iv: "2d955ed3080b7d53d44435ad204df834"
server_key_version: "encryptionkey@0"
I20260811 16:45:24.792448 21812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:24.805588 21812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:24.807773 21812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:24.807953 21812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:24.812381 21812 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:39941
I20260811 16:45:24.812446 21915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:39941 every 8 connection(s)
I20260811 16:45:24.812820 21812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:45:24.813741 21917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:24.816368 21917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Bootstrap starting.
I20260811 16:45:24.817018 21917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:24.817332 21917 log.cc:824] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:24.818171 21917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: No bootstrap required, opened a new log
I20260811 16:45:24.818452 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 21812
I20260811 16:45:24.818574 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:45:24.818781 28393 external_mini_cluster.cc:1428] Setting key 186d5a57c68a187ca563efac4f2abb35
I20260811 16:45:24.820644 21917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:45:24.820829 21917 raft_consensus.cc:374] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:24.820869 21917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cc46df3ad44148517ac98346953e6, State: Initialized, Role: FOLLOWER
I20260811 16:45:24.821043 21917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:45:24.821130 21917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:45:24.821153 21917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:45:24.821221 21917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:24.822350 21917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:45:24.822475 21917 leader_election.cc:302] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 448cc46df3ad44148517ac98346953e6; no voters:
I20260811 16:45:24.822645 21917 leader_election.cc:288] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:45:24.822714 21925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:45:24.822861 21925 raft_consensus.cc:686] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 1 LEADER]: Becoming Leader. State: Replica: 448cc46df3ad44148517ac98346953e6, State: Running, Role: LEADER
I20260811 16:45:24.822872 21917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:24.824247 21925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:45:24.824858 21928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "448cc46df3ad44148517ac98346953e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } } }
I20260811 16:45:24.825002 21928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:24.825109 21926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 448cc46df3ad44148517ac98346953e6. Latest consensus state: current_term: 1 leader_uuid: "448cc46df3ad44148517ac98346953e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } } }
I20260811 16:45:24.825450 21926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: This master's current role is: LEADER
W20260811 16:45:24.825812 21948 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:45:24.825877 21948 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:45:24.825980 21951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:45:24.826186 21951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 16:45:24 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466724, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:24.827811 21951 catalog_manager.cc:1347] Generated new cluster ID: 4e9fe765114d466a8be9178b5097aad7
I20260811 16:45:24.827864 21951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:45:24.831851 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:24.819357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39874 (local address 127.27.186.126:39941)
0811 16:45:24.819604 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:24.819614 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:24.819654 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:45:24.820603 (+ 949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:24.820612 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:24.820681 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:24.820847 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:24.821646 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:24.823152 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:24.823994 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:24.824585 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:24.824712 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:24.828107 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:24.828111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:24.828112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:24.828123 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:24.830072 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:24.830429 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:24.830433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:24.830433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:24.830552 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:24.830722 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:24.830722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:24.830722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:24.831012 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:24.831134 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:24.831531 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 16:45:24.831660 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":112,"threads_started":1}
I20260811 16:45:24.856261 21951 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:45:24.857050 21951 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:45:24.869249 21951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Generated new TSK 0
I20260811 16:45:24.869554 21951 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:45:24.909523 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39941
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:24.992856 21957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:24.993112 21957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:24.993153 21957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:24.994361 21957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:24.994436 21957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:24.994488 21957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:45:24.996119 21957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:24.996407 21957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:24.996658 21957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:45:25.002117 21957 server_base.cc:1034] running on GCE node
W20260811 16:45:25.002136 21969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:25.002044 21970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:25.002032 21974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:25.002429 21957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:25.002692 21957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:25.003872 21957 hybrid_clock.cc:648] HybridClock initialized: now 1786466725003866 us; error 36 us; skew 500 ppm
Aug 11 16:45:25 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:25.006614 21957 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:45:25.007110 21957 webserver.cc:460] Webserver started at http://127.27.186.65:37927/ using document root <none> and password file <none>
I20260811 16:45:25.007345 21957 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:25.007392 21957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:25.007552 21957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:25.008652 21957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "4ef163caa4ad448cb154b304a3b4a293"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "4c12e243f735ecd5db7f8228e5bc8487"
server_key_iv: "1317359e58b1462ea015158a00dd4dde"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.009050 21957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "4ef163caa4ad448cb154b304a3b4a293"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "4c12e243f735ecd5db7f8228e5bc8487"
server_key_iv: "1317359e58b1462ea015158a00dd4dde"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.010512 21957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:45:25.011291 21983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.011510 21957 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:45:25.011610 21957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "4ef163caa4ad448cb154b304a3b4a293"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "4c12e243f735ecd5db7f8228e5bc8487"
server_key_iv: "1317359e58b1462ea015158a00dd4dde"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.011693 21957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:25.032040 21957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:25.034355 21957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:25.034511 21957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:25.034785 21957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:25.035123 21957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:25.035159 21957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.035182 21957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:25.035195 21957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.041435 21957 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:34507
I20260811 16:45:25.041530 22154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:34507 every 8 connection(s)
I20260811 16:45:25.041888 21957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:45:25.045867 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 21957
I20260811 16:45:25.045981 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:45:25.046173 28393 external_mini_cluster.cc:1428] Setting key 6638c869dd1fc6fff155a802cf96aead
Aug 11 16:45:25 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:25.052037 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.042733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:59863 (local address 127.27.186.126:39941)
0811 16:45:25.042813 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.042815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.043047 (+ 232us) server_negotiation.cc:407] Connection header received
0811 16:45:25.043525 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.043526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.043539 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.043588 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:25.044519 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.045022 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.046381 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.046665 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.046749 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.048991 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:25.048993 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:25.048993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:25.049001 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:25.050543 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:25.050988 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:25.050990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:25.050991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:25.051051 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:25.051317 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:25.051318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:25.051319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:25.051437 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:25.051515 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.051815 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.051915 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 16:45:25.052187 22159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.042704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:59863)
0811 16:45:25.042904 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.042949 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:25.043431 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:25.043649 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:25.043652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:25.044231 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:25.044432 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.044437 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.045108 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.045108 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.046255 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.046259 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.046760 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.046762 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.046897 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.047444 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:25.047452 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:25.048880 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:25.050648 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:25.050657 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:25.050659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:25.050891 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:25.051119 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:25.051119 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:25.051120 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:25.051239 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:25.051518 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:25.051526 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:25.051672 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 16:45:25.051780 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 16:45:25.051948 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":110,"threads_started":1}
I20260811 16:45:25.052686 22155 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39941
I20260811 16:45:25.052809 22155 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:25.053028 22155 heartbeater.cc:511] Master 127.27.186.126:39941 requested a full tablet report, sending...
I20260811 16:45:25.053632 21864 ts_manager.cc:194] Registered new tserver with Master: 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507)
I20260811 16:45:25.054265 21864 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:59863
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:45:25.076624 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39941
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:25.161247 22164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:25.161458 22164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:25.161509 22164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:25.162715 22164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:25.162760 22164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:25.162786 22164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:45:25.164187 22164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:25.164377 22164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:25.164561 22164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:25.169713 22179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:25.169739 22175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:25.169920 22164 server_base.cc:1034] running on GCE node
W20260811 16:45:25.169750 22182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:25.170279 22164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:25.170584 22164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:25.171774 22164 hybrid_clock.cc:648] HybridClock initialized: now 1786466725171749 us; error 37 us; skew 500 ppm
Aug 11 16:45:25 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:25.174844 22164 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:45:25.175311 22164 webserver.cc:460] Webserver started at http://127.27.186.66:36623/ using document root <none> and password file <none>
I20260811 16:45:25.175562 22164 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:25.175632 22164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:25.175791 22164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:25.176911 22164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "590ca9fe19ec4a2cb334888137c89b86"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "3f3b5289f2be15cc198d5ce3c6a78c19"
server_key_iv: "36598a646935b5b69a5d650a26653c44"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.177295 22164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "590ca9fe19ec4a2cb334888137c89b86"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "3f3b5289f2be15cc198d5ce3c6a78c19"
server_key_iv: "36598a646935b5b69a5d650a26653c44"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.178761 22164 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:45:25.179642 22191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.179860 22164 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:45:25.179975 22164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "590ca9fe19ec4a2cb334888137c89b86"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "3f3b5289f2be15cc198d5ce3c6a78c19"
server_key_iv: "36598a646935b5b69a5d650a26653c44"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.180060 22164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:25.199173 22164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:25.201682 22164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:25.201865 22164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:25.202131 22164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:25.202456 22164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:25.202520 22164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.202561 22164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:25.202608 22164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.208724 22164 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:44597
I20260811 16:45:25.208834 22384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:44597 every 8 connection(s)
I20260811 16:45:25.209156 22164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:45:25.212779 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 22164
I20260811 16:45:25.212895 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:45:25.213088 28393 external_mini_cluster.cc:1428] Setting key 151178a3d8943fe633a776c9ec8da633
Aug 11 16:45:25 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:25.219774 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.209952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:45799 (local address 127.27.186.126:39941)
0811 16:45:25.210049 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.210052 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.210208 (+ 156us) server_negotiation.cc:407] Connection header received
0811 16:45:25.210686 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.210687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.210698 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.210756 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:25.211682 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.212188 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.213578 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.213860 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.213926 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.216749 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:25.216750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:25.216751 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:25.216759 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:25.218272 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:25.218801 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:25.218802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:25.218802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:25.218850 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:25.219136 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:25.219137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:25.219137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:25.219235 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:25.219286 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.219639 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.219709 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 16:45:25.220094 22389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.209896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:45799)
0811 16:45:25.210075 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.210113 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:25.210603 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:25.210812 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:25.210815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:25.211401 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:25.211600 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.211606 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.212314 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.212315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.213450 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.213453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.213953 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.213954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.214118 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.214728 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:25.214739 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:25.216645 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:25.218371 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:25.218380 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:25.218392 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:25.218720 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:25.218918 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:25.218919 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:25.218920 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:25.219069 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:25.219301 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:25.219308 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:25.219493 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 16:45:25.219623 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 16:45:25.219821 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":117,"threads_started":1}
I20260811 16:45:25.220675 22385 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39941
I20260811 16:45:25.220796 22385 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:25.221019 22385 heartbeater.cc:511] Master 127.27.186.126:39941 requested a full tablet report, sending...
I20260811 16:45:25.221444 21864 ts_manager.cc:194] Registered new tserver with Master: 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597)
I20260811 16:45:25.221854 21864 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:45799
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:45:25.242174 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39941
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:25.327257 22394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:25.327471 22394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:25.327497 22394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:25.328615 22394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:25.328652 22394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:25.328678 22394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:45:25.330175 22394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:25.330363 22394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:25.330555 22394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:25.335733 22414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:25.335759 22411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:25.335791 22394 server_base.cc:1034] running on GCE node
W20260811 16:45:25.335753 22407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:25.336194 22394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:25.336457 22394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:25.337636 22394 hybrid_clock.cc:648] HybridClock initialized: now 1786466725337616 us; error 38 us; skew 500 ppm
Aug 11 16:45:25 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:25.340222 22394 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:45:25.340694 22394 webserver.cc:460] Webserver started at http://127.27.186.67:43493/ using document root <none> and password file <none>
I20260811 16:45:25.340955 22394 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:25.341027 22394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:25.341183 22394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:45:25.342344 22394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "8055115f5a4c4e21bd8142140c28ea3d"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "0dec28ed13944781a70b2aa14b0c6523"
server_key_iv: "6d4f3c44f9c4d04e4679bc459e132c6f"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.342733 22394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "8055115f5a4c4e21bd8142140c28ea3d"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "0dec28ed13944781a70b2aa14b0c6523"
server_key_iv: "6d4f3c44f9c4d04e4679bc459e132c6f"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.344111 22394 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:45:25.344854 22425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.345031 22394 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:45:25.345146 22394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "8055115f5a4c4e21bd8142140c28ea3d"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "0dec28ed13944781a70b2aa14b0c6523"
server_key_iv: "6d4f3c44f9c4d04e4679bc459e132c6f"
server_key_version: "encryptionkey@0"
I20260811 16:45:25.345227 22394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:25.359297 22394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:25.361711 22394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:25.361891 22394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:25.362139 22394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:25.362463 22394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:25.362527 22394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.362571 22394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:25.362601 22394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:25.368552 22394 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:40313
I20260811 16:45:25.368657 22604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:40313 every 8 connection(s)
I20260811 16:45:25.368955 22394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:45:25 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466725, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:25.377724 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 22394
I20260811 16:45:25.377825 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:45:25.378015 28393 external_mini_cluster.cc:1428] Setting key 27c602c739be6dab8d21008b61264f09
I20260811 16:45:25.378520 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.369876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:60823 (local address 127.27.186.126:39941)
0811 16:45:25.369945 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.369947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.370168 (+ 221us) server_negotiation.cc:407] Connection header received
0811 16:45:25.370727 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.370728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.370741 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.370808 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:25.371748 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.372279 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.373286 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.373553 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.373620 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.375825 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:25.375826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:25.375827 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:25.375835 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:25.377039 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:25.377447 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:25.377448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:25.377449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:25.377534 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:25.377814 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:25.377815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:25.377816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:25.377959 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:25.378042 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.378347 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.378430 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:45:25.378715 22608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.369869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:60823)
0811 16:45:25.370041 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.370077 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:25.370614 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:25.370878 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:25.370882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:25.371440 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:25.371639 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.371644 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.372384 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.372385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.373186 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.373189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.373629 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.373630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.373756 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.374308 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:25.374316 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:25.375722 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:25.377126 (+ 1404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:25.377134 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:25.377136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:25.377351 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:25.377627 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:25.377628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:25.377628 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:25.377735 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:25.378045 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:25.378053 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:25.378201 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 16:45:25.378312 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 16:45:25.378473 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":84,"threads_started":1}
I20260811 16:45:25.379223 22605 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39941
I20260811 16:45:25.379338 22605 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:25.379528 22605 heartbeater.cc:511] Master 127.27.186.126:39941 requested a full tablet report, sending...
I20260811 16:45:25.379899 21864 ts_manager.cc:194] Registered new tserver with Master: 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313)
I20260811 16:45:25.380275 21864 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:60823
I20260811 16:45:25.390094 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:45:25.397280 21923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.391498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38370 (local address 127.27.186.126:39941)
0811 16:45:25.391587 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.391589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.391640 (+ 51us) server_negotiation.cc:407] Connection header received
0811 16:45:25.391682 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.391682 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.391691 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.391739 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:25.392268 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.392747 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.393443 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.393695 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.393749 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.394909 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:25.394910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:25.394910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:25.394916 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:25.396318 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:25.396618 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:25.396618 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:25.396619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:25.396669 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:25.396830 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:25.396830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:25.396830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:25.396968 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:25.397048 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.397130 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.397191 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 16:45:25.398883 21864 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:45:25.400435 21864 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:45:25.407857 22629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.403220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48186 (local address 127.27.186.65:34507)
0811 16:45:25.403408 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.403413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.403589 (+ 176us) server_negotiation.cc:407] Connection header received
0811 16:45:25.403663 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.403666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.403682 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.403756 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:25.403986 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.405181 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.406878 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.407389 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.407486 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.407554 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.407728 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.407772 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260811 16:45:25.407954 22617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.402939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40313 (local address 127.0.0.1:55876)
0811 16:45:25.403108 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.403152 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:25.403220 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:25.404071 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:25.404071 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:25.404072 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:25.404102 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.404103 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.405311 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.405312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.406760 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.406762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.407711 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.407712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.407779 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.407783 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:45:25.407812 (+ 29us) client_negotiation.cc:240] Negotiation successful
0811 16:45:25.407856 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":51,"thread_start_us":64,"threads_started":1}
I20260811 16:45:25.407847 22621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.402954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:34507 (local address 127.0.0.1:48186)
0811 16:45:25.403519 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.403525 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:25.403584 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:25.403848 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:25.403849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:25.403851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:25.403900 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.403901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.405314 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.405314 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.406758 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.406762 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.407489 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.407490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.407574 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.407588 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:45:25.407688 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 16:45:25.407750 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"mutex_wait_us":54,"thread_start_us":102,"threads_started":1}
I20260811 16:45:25.408120 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.403160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55876 (local address 127.27.186.67:40313)
0811 16:45:25.403917 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.403922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.403931 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:45:25.403970 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.403972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.403988 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.404078 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:25.404164 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.405210 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.406859 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.407614 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.407900 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.407967 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.407993 (+ 26us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.408034 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":110,"threads_started":1}
I20260811 16:45:25.408643 22622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.402946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:44597 (local address 127.0.0.1:37284)
0811 16:45:25.403406 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.403416 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:25.403460 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:25.403701 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:25.403704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:25.403708 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:25.403784 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.403786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.406333 (+ 2547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.406334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.407397 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.407401 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.408346 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.408347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.408445 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.408448 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:45:25.408514 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:45:25.408560 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":84,"threads_started":1}
I20260811 16:45:25.408972 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.403170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37284 (local address 127.27.186.66:44597)
0811 16:45:25.403495 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.403498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.403506 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:45:25.403563 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.403565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.403583 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.405343 (+ 1760us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:25.405417 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.406222 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.407505 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.408245 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.408356 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.408452 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.408542 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.408891 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":92,"threads_started":1}
I20260811 16:45:25.408972 22496 tablet_service.cc:1467] Processing CreateTablet for tablet 16ec30a29cb44e71bfaf3aef5418e666 (DEFAULT_TABLE table=test-table [id=feb82f3a41a54694b1ca8802e193b19a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:25.409394 22496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ec30a29cb44e71bfaf3aef5418e666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:25.409704 22270 tablet_service.cc:1467] Processing CreateTablet for tablet 16ec30a29cb44e71bfaf3aef5418e666 (DEFAULT_TABLE table=test-table [id=feb82f3a41a54694b1ca8802e193b19a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:25.410064 22270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ec30a29cb44e71bfaf3aef5418e666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:25.413187 22635 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: Bootstrap starting.
I20260811 16:45:25.413591 22637 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Bootstrap starting.
I20260811 16:45:25.413923 22060 tablet_service.cc:1467] Processing CreateTablet for tablet 16ec30a29cb44e71bfaf3aef5418e666 (DEFAULT_TABLE table=test-table [id=feb82f3a41a54694b1ca8802e193b19a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:25.414048 22635 tablet_bootstrap.cc:654] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:25.414269 22060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ec30a29cb44e71bfaf3aef5418e666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:25.414278 22637 tablet_bootstrap.cc:654] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:25.414597 22635 log.cc:824] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:25.414867 22637 log.cc:824] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:25.415565 22635 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: No bootstrap required, opened a new log
I20260811 16:45:25.415630 22635 ts_tablet_manager.cc:1397] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:45:25.415644 22637 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: No bootstrap required, opened a new log
I20260811 16:45:25.415702 22637 ts_tablet_manager.cc:1397] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:45:25.417510 22643 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Bootstrap starting.
I20260811 16:45:25.417688 22635 raft_consensus.cc:348] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.417688 22637 raft_consensus.cc:348] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.417876 22637 raft_consensus.cc:374] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:25.417876 22635 raft_consensus.cc:374] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:25.417914 22637 raft_consensus.cc:729] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ca9fe19ec4a2cb334888137c89b86, State: Initialized, Role: FOLLOWER
I20260811 16:45:25.417914 22635 raft_consensus.cc:729] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8055115f5a4c4e21bd8142140c28ea3d, State: Initialized, Role: FOLLOWER
I20260811 16:45:25.418038 22637 consensus_queue.cc:260] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.418058 22635 consensus_queue.cc:260] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.418161 22643 tablet_bootstrap.cc:654] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:25.418332 22637 ts_tablet_manager.cc:1428] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:45:25.418332 22635 ts_tablet_manager.cc:1428] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:45:25.418447 22605 heartbeater.cc:503] Master 127.27.186.126:39941 was elected leader, sending a full tablet report...
I20260811 16:45:25.418444 22385 heartbeater.cc:503] Master 127.27.186.126:39941 was elected leader, sending a full tablet report...
I20260811 16:45:25.418740 22643 log.cc:824] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:25.419574 22643 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: No bootstrap required, opened a new log
I20260811 16:45:25.419651 22643 ts_tablet_manager.cc:1397] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:25.421022 22643 raft_consensus.cc:348] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.421183 22643 raft_consensus.cc:374] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:25.421231 22643 raft_consensus.cc:729] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef163caa4ad448cb154b304a3b4a293, State: Initialized, Role: FOLLOWER
I20260811 16:45:25.421350 22643 consensus_queue.cc:260] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.421650 22643 ts_tablet_manager.cc:1428] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:45:25.421695 22155 heartbeater.cc:503] Master 127.27.186.126:39941 was elected leader, sending a full tablet report...
W20260811 16:45:25.459784 22386 tablet.cc:2369] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:45:25.542721 22158 tablet.cc:2369] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:45:25.560855 22647 raft_consensus.cc:482] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:25.561079 22647 raft_consensus.cc:504] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.561568 22647 leader_election.cc:288] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597), 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507)
I20260811 16:45:25.564606 22625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.561907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:56685 (local address 127.27.186.66:44597)
0811 16:45:25.561981 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.561984 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.562089 (+ 105us) server_negotiation.cc:407] Connection header received
0811 16:45:25.562164 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.562165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.562175 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.562244 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:25.562411 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.562873 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.563845 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.564227 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.564316 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.564324 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.564497 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.564536 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:45:25.564608 22629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.561916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:43197 (local address 127.27.186.65:34507)
0811 16:45:25.561983 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.561985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.561997 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:45:25.562033 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.562034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.562046 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.562127 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:25.562348 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.562872 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.563842 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.564206 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.564294 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.564305 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.564494 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.564533 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:45:25.564625 22608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.561769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:34507 (local address 127.27.186.67:43197)
0811 16:45:25.561848 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.561863 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:25.561937 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:25.562133 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:25.562134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:25.562136 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:25.562223 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.562225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.562968 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.562969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.563714 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.563717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.564317 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.564318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.564400 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.564404 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:45:25.564485 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:45:25.564529 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":1}
I20260811 16:45:25.564628 22651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.561780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:44597 (local address 127.27.186.67:56685)
0811 16:45:25.561999 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.562010 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:25.562101 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:25.562263 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:25.562263 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:25.562265 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:25.562340 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.562341 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.562983 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.562985 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.563748 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:25.563750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.564317 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.564318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:25.564397 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.564401 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:45:25.564484 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:45:25.564525 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":14,"thread_start_us":108,"threads_started":1}
I20260811 16:45:25.565065 22089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ec30a29cb44e71bfaf3aef5418e666" candidate_uuid: "8055115f5a4c4e21bd8142140c28ea3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef163caa4ad448cb154b304a3b4a293" is_pre_election: true
I20260811 16:45:25.565248 22089 raft_consensus.cc:2454] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8055115f5a4c4e21bd8142140c28ea3d in term 0.
I20260811 16:45:25.565325 22308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ec30a29cb44e71bfaf3aef5418e666" candidate_uuid: "8055115f5a4c4e21bd8142140c28ea3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ca9fe19ec4a2cb334888137c89b86" is_pre_election: true
I20260811 16:45:25.565531 22308 raft_consensus.cc:2454] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8055115f5a4c4e21bd8142140c28ea3d in term 0.
I20260811 16:45:25.565526 22428 leader_election.cc:302] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ef163caa4ad448cb154b304a3b4a293, 8055115f5a4c4e21bd8142140c28ea3d; no voters:
I20260811 16:45:25.565676 22647 raft_consensus.cc:2781] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:45:25.565739 22647 raft_consensus.cc:482] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:45:25.565768 22647 raft_consensus.cc:3037] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:25.566543 22647 raft_consensus.cc:504] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.566686 22647 leader_election.cc:288] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [CANDIDATE]: Term 1 election: Requested vote from peers 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597), 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507)
I20260811 16:45:25.566836 22308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ec30a29cb44e71bfaf3aef5418e666" candidate_uuid: "8055115f5a4c4e21bd8142140c28ea3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ca9fe19ec4a2cb334888137c89b86"
I20260811 16:45:25.566845 22089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ec30a29cb44e71bfaf3aef5418e666" candidate_uuid: "8055115f5a4c4e21bd8142140c28ea3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef163caa4ad448cb154b304a3b4a293"
I20260811 16:45:25.566949 22308 raft_consensus.cc:3037] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:25.566951 22089 raft_consensus.cc:3037] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:25.567744 22089 raft_consensus.cc:2454] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8055115f5a4c4e21bd8142140c28ea3d in term 1.
I20260811 16:45:25.567755 22308 raft_consensus.cc:2454] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8055115f5a4c4e21bd8142140c28ea3d in term 1.
I20260811 16:45:25.567919 22428 leader_election.cc:302] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ef163caa4ad448cb154b304a3b4a293, 8055115f5a4c4e21bd8142140c28ea3d; no voters:
I20260811 16:45:25.568009 22647 raft_consensus.cc:2781] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:45:25.568197 22647 raft_consensus.cc:686] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 1 LEADER]: Becoming Leader. State: Replica: 8055115f5a4c4e21bd8142140c28ea3d, State: Running, Role: LEADER
I20260811 16:45:25.568354 22647 consensus_queue.cc:237] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:25.569340 21864 catalog_manager.cc:5495] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67). New cstate: current_term: 1 leader_uuid: "8055115f5a4c4e21bd8142140c28ea3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } health_report { overall_health: UNKNOWN } } }
I20260811 16:45:25.588239 22626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.585921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55882 (local address 127.27.186.67:40313)
0811 16:45:25.585983 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:25.585985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:25.586000 (+ 15us) server_negotiation.cc:407] Connection header received
0811 16:45:25.586035 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:25.586036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:25.586054 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:25.586117 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:45:25.586289 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.586771 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.587542 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:25.587723 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:25.587777 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:25.587911 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:45:25.588009 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:45:25.588072 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:25.588111 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 16:45:25.588130 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:45:25.590373 22089 raft_consensus.cc:1261] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Refusing update from remote peer 8055115f5a4c4e21bd8142140c28ea3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:25.590373 22308 raft_consensus.cc:1261] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 1 FOLLOWER]: Refusing update from remote peer 8055115f5a4c4e21bd8142140c28ea3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:25.590783 22652 consensus_queue.cc:1035] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:25.590975 22647 consensus_queue.cc:1035] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:25.593657 22665 mvcc.cc:205] Tried to move back new op lower bound from 7317367708014944256 to 7317367707928641536. Current Snapshot: MvccSnapshot[applied={T|T < 7317367708014944256}]
I20260811 16:45:25.594095 22662 mvcc.cc:205] Tried to move back new op lower bound from 7317367708014944256 to 7317367707928641536. Current Snapshot: MvccSnapshot[applied={T|T < 7317367708014944256 or (T in {7317367708014944256})}]
I20260811 16:45:25.595960 21860 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:45:25.596068 21860 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:45:25.596815 21860 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Sending DeleteTablet for 3 replicas of tablet 16ec30a29cb44e71bfaf3aef5418e666
I20260811 16:45:25.597215 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 21957
I20260811 16:45:25.597206 22496 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ec30a29cb44e71bfaf3aef5418e666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:25 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:55876
I20260811 16:45:25.597224 22060 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ec30a29cb44e71bfaf3aef5418e666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:25 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:48186
I20260811 16:45:25.597430 22270 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ec30a29cb44e71bfaf3aef5418e666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:25 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:37284
I20260811 16:45:25.601003 22676 tablet_replica.cc:330] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: stopping tablet replica
I20260811 16:45:25.601125 22676 raft_consensus.cc:2229] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:45:25.601259 22676 raft_consensus.cc:2258] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:25.601431 22681 tablet_replica.cc:330] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: stopping tablet replica
I20260811 16:45:25.601568 22681 raft_consensus.cc:2229] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:25.601675 22681 raft_consensus.cc:2258] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:25.601912 22676 ts_tablet_manager.cc:1905] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:25.602083 22681 ts_tablet_manager.cc:1905] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:25.603708 22676 ts_tablet_manager.cc:1918] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:25.603785 22676 log.cc:1196] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/16ec30a29cb44e71bfaf3aef5418e666
I20260811 16:45:25.604095 22676 ts_tablet_manager.cc:1939] T 16ec30a29cb44e71bfaf3aef5418e666 P 8055115f5a4c4e21bd8142140c28ea3d: Deleting consensus metadata
I20260811 16:45:25.604084 22681 ts_tablet_manager.cc:1918] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:25.604166 22681 log.cc:1196] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/16ec30a29cb44e71bfaf3aef5418e666
I20260811 16:45:25.604573 22681 ts_tablet_manager.cc:1939] T 16ec30a29cb44e71bfaf3aef5418e666 P 590ca9fe19ec4a2cb334888137c89b86: Deleting consensus metadata
I20260811 16:45:25.604621 21841 catalog_manager.cc:4841] TS 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313): tablet 16ec30a29cb44e71bfaf3aef5418e666 (table test-table [id=feb82f3a41a54694b1ca8802e193b19a]) successfully deleted
I20260811 16:45:25.605587 21844 catalog_manager.cc:4841] TS 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597): tablet 16ec30a29cb44e71bfaf3aef5418e666 (table test-table [id=feb82f3a41a54694b1ca8802e193b19a]) successfully deleted
W20260811 16:45:25.606820 21843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:34507 (error 108)
I20260811 16:45:25.607084 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 22164
I20260811 16:45:25.613587 22622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:25.613384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:34507 (local address 127.0.0.1:48202)
0811 16:45:25.613451 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:25.613541 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:34507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 16:45:25.613736 21843 catalog_manager.cc:4584] TS 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 16ec30a29cb44e71bfaf3aef5418e666: Network error: Client connection negotiation failed: client connection to 127.27.186.65:34507: connect: Connection refused (error 111)
I20260811 16:45:25.620658 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 22394
I20260811 16:45:25.645135 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 21812
I20260811 16:45:45.653330 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39941
--webserver_interface=127.27.186.126
--webserver_port=35719
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:39941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:45:45.738423 22683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:45.738626 22683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:45.738648 22683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:45.739774 22683 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:45:45.739815 22683 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:45:45.739828 22683 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:45:45.739840 22683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:45:45.739852 22683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:45.739866 22683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:45.739915 22683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:45:45.739933 22683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:45:45.741395 22683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:39941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=35719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:45.741662 22683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:45.741904 22683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:45.753257 22693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:45.753288 22697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:45.753274 22691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:45.753551 22683 server_base.cc:1034] running on GCE node
I20260811 16:45:45.753824 22683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:45.754208 22683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:45.755410 22683 hybrid_clock.cc:648] HybridClock initialized: now 1786466745755388 us; error 34 us; skew 500 ppm
Aug 11 16:45:45 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466745, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:45.758814 22683 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:45:45.759348 22683 webserver.cc:460] Webserver started at http://127.27.186.126:35719/ using document root <none> and password file <none>
I20260811 16:45:45.759616 22683 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:45.759703 22683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:45.761217 22683 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:45:45.761999 22707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:45.762177 22683 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:45.762285 22683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "448cc46df3ad44148517ac98346953e6"
format_stamp: "Formatted at 2026-08-11 16:45:24 on dist-test-slave-gsp7"
server_key: "3247707deca032568f49c5866500911f"
server_key_iv: "2d955ed3080b7d53d44435ad204df834"
server_key_version: "encryptionkey@0"
I20260811 16:45:45.762739 22683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:45.772379 22683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:45.774459 22683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:45.774626 22683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:45.778970 22683 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:39941
I20260811 16:45:45.779006 22784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:39941 every 8 connection(s)
I20260811 16:45:45.779397 22683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:45:45.781417 22787 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:45:45.782126 22787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Bootstrap starting.
I20260811 16:45:45.789721 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 22683
I20260811 16:45:45.790109 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:34507
--local_ip_for_outbound_sockets=127.27.186.65
--tserver_master_addrs=127.27.186.126:39941
--webserver_port=37927
--webserver_interface=127.27.186.65
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:45.792773 22787 log.cc:824] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:45.794858 22787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:45:45.795178 22787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Bootstrap complete.
I20260811 16:45:45.797598 22787 raft_consensus.cc:348] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:45:45.797838 22787 raft_consensus.cc:729] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cc46df3ad44148517ac98346953e6, State: Initialized, Role: FOLLOWER
I20260811 16:45:45.798008 22787 consensus_queue.cc:260] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:45:45.798094 22787 raft_consensus.cc:388] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:45:45.798156 22787 raft_consensus.cc:482] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:45:45.798230 22787 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 16:45:45.799285 22787 raft_consensus.cc:504] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:45:45.799419 22787 leader_election.cc:302] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 448cc46df3ad44148517ac98346953e6; no voters:
I20260811 16:45:45.799628 22787 leader_election.cc:288] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 16:45:45.799664 22795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 16:45:45.799791 22795 raft_consensus.cc:686] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 2 LEADER]: Becoming Leader. State: Replica: 448cc46df3ad44148517ac98346953e6, State: Running, Role: LEADER
I20260811 16:45:45.799912 22787 sys_catalog.cc:564] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:45:45.799952 22795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:45:45.800310 22799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "448cc46df3ad44148517ac98346953e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } } }
I20260811 16:45:45.800397 22799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:45.800329 22800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 448cc46df3ad44148517ac98346953e6. Latest consensus state: current_term: 2 leader_uuid: "448cc46df3ad44148517ac98346953e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } } }
I20260811 16:45:45.800462 22800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:45:45.800953 22808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:45:45.801849 22808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:45:45.801981 22808 catalog_manager.cc:1259] Loaded cluster ID: 4e9fe765114d466a8be9178b5097aad7
I20260811 16:45:45.802057 22808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:45:45.803319 22808 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:45:45.803514 22808 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Loaded TSK: 0
I20260811 16:45:45.817256 22808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Generated new TSK 1
I20260811 16:45:45.817373 22808 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:45:45.876147 22791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:45.876394 22791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:45.876435 22791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:45.877693 22791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:45.877759 22791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:45.877805 22791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:45:45.879380 22791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:34507
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=37927
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:45.879660 22791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:45.879917 22791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:45.886160 22837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:45.886142 22840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:45.886399 22791 server_base.cc:1034] running on GCE node
W20260811 16:45:45.886178 22832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:45.886710 22791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:45.887005 22791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:45.888180 22791 hybrid_clock.cc:648] HybridClock initialized: now 1786466745888169 us; error 28 us; skew 500 ppm
Aug 11 16:45:45 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466745, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:45.891198 22791 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:45:45.891645 22791 webserver.cc:460] Webserver started at http://127.27.186.65:37927/ using document root <none> and password file <none>
I20260811 16:45:45.891906 22791 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:45.892001 22791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:45.893452 22791 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:45:45.894264 22851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:45.894448 22791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:45.894560 22791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "4ef163caa4ad448cb154b304a3b4a293"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "4c12e243f735ecd5db7f8228e5bc8487"
server_key_iv: "1317359e58b1462ea015158a00dd4dde"
server_key_version: "encryptionkey@0"
I20260811 16:45:45.894932 22791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:45.915771 22791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:45.918076 22791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:45.918251 22791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:45.918516 22791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:45.918987 22861 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:45:45.920884 22791 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:45:45.920961 22791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:45:45.921027 22791 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:45:45.921779 22791 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:45:45.921834 22791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:45.921907 22861 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Bootstrap starting.
I20260811 16:45:45.929369 22791 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:34507
I20260811 16:45:45.929415 23045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:34507 every 8 connection(s)
I20260811 16:45:45.929909 22791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:45:45.934552 22861 log.cc:824] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:45.936592 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 22791
I20260811 16:45:45.936889 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:44597
--local_ip_for_outbound_sockets=127.27.186.66
--tserver_master_addrs=127.27.186.126:39941
--webserver_port=36623
--webserver_interface=127.27.186.66
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:45.936913 22861 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:45:45.937204 22861 tablet_bootstrap.cc:492] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Bootstrap complete.
I20260811 16:45:45.938493 22861 ts_tablet_manager.cc:1397] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.014s
I20260811 16:45:45.939949 22861 raft_consensus.cc:348] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:45.940217 22861 raft_consensus.cc:729] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef163caa4ad448cb154b304a3b4a293, State: Initialized, Role: FOLLOWER
I20260811 16:45:45.940361 22861 consensus_queue.cc:260] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:45.940665 22861 ts_tablet_manager.cc:1428] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
Aug 11 16:45:45 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466745, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:45.945313 23051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:45.930817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:58751 (local address 127.27.186.126:39941)
0811 16:45:45.933880 (+ 3063us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:45.933887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:45.933921 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:45:45.934038 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:45.934043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:45.934087 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:45.934246 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:45.935042 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:45.936421 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:45.938026 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:45.938646 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:45.938729 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:45.941568 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:45.941572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:45.941573 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:45.941584 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:45.943309 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:45.943858 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:45.943860 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:45.943860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:45.943946 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:45.944298 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:45.944300 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:45.944300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:45.944603 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:45.944679 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:45.945061 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 16:45:45.945172 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3009,"thread_start_us":112,"threads_started":1}
I20260811 16:45:45.945504 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:45.930726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:58751)
0811 16:45:45.930964 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:45.931015 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:45.931503 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:45.934278 (+ 2775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:45.934283 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:45.934589 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:45.934885 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:45.934893 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:45.936574 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:45.936575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:45.937920 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:45.937924 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:45.938889 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:45.938890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:45.939019 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:45.939682 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:45.939693 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:45.941371 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:45.943419 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:45.943426 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:45.943428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:45.943766 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:45.944028 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:45.944029 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:45.944030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:45.944191 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:45.944693 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:45.944702 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:45.944881 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 16:45:45.945013 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 16:45:45.945212 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":126,"threads_started":1}
I20260811 16:45:45.946223 23046 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39941
I20260811 16:45:45.946337 23046 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:45.946517 23046 heartbeater.cc:511] Master 127.27.186.126:39941 requested a full tablet report, sending...
I20260811 16:45:45.947325 22729 ts_manager.cc:194] Registered new tserver with Master: 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507)
I20260811 16:45:45.948410 22729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:58751
I20260811 16:45:45.949256 23046 heartbeater.cc:503] Master 127.27.186.126:39941 was elected leader, sending a full tablet report...
I20260811 16:45:45.956936 23060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:45.948025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46934 (local address 127.27.186.65:34507)
0811 16:45:45.953641 (+ 5616us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:45.953645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:45.953656 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:45:45.953685 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:45.953686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:45.953700 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:45.953772 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:45.953971 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:45.954675 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:45.956147 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:45.956582 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:45.956640 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:45.956675 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:45.956855 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 16:45:45.956884 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5584,"thread_start_us":91,"threads_started":1}
I20260811 16:45:45.956966 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:45.947951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:34507 (local address 127.0.0.1:46934)
0811 16:45:45.948142 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:45.948192 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:45.948281 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:45.953809 (+ 5528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:45.953813 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:45.953816 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:45.953890 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:45.953892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:45.954751 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:45.954752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:45.956062 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:45.956065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:45.956661 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:45.956662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:45.956747 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:45.956762 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 16:45:45.956836 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 16:45:45.956890 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":99,"threads_started":1}
I20260811 16:45:45.957381 22934 tablet_service.cc:1514] Processing DeleteTablet for tablet 16ec30a29cb44e71bfaf3aef5418e666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:25 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:46934
I20260811 16:45:45.957973 23061 tablet_replica.cc:330] stopping tablet replica
I20260811 16:45:45.958088 23061 raft_consensus.cc:2229] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:45.958180 23061 raft_consensus.cc:2258] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:45.958470 23061 ts_tablet_manager.cc:1905] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:45.960558 23061 ts_tablet_manager.cc:1918] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:45.960620 23061 log.cc:1196] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal/wals/16ec30a29cb44e71bfaf3aef5418e666
I20260811 16:45:45.960862 23061 ts_tablet_manager.cc:1939] T 16ec30a29cb44e71bfaf3aef5418e666 P 4ef163caa4ad448cb154b304a3b4a293: Deleting consensus metadata
I20260811 16:45:45.961364 22712 catalog_manager.cc:4841] TS 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507): tablet 16ec30a29cb44e71bfaf3aef5418e666 (table test-table [id=feb82f3a41a54694b1ca8802e193b19a]) successfully deleted
W20260811 16:45:46.027277 23056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:46.027518 23056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:46.027559 23056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:46.028709 23056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:46.028780 23056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:46.028842 23056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:45:46.030417 23056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:44597
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=36623
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:46.030683 23056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:46.030943 23056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:46.036875 23070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:46.036880 23075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:46.036937 23056 server_base.cc:1034] running on GCE node
W20260811 16:45:46.036885 23072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:46.037272 23056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:46.037585 23056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:46.038748 23056 hybrid_clock.cc:648] HybridClock initialized: now 1786466746038732 us; error 27 us; skew 500 ppm
Aug 11 16:45:46 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466746, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:46.041257 23056 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:45:46.041796 23056 webserver.cc:460] Webserver started at http://127.27.186.66:36623/ using document root <none> and password file <none>
I20260811 16:45:46.042054 23056 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:46.042147 23056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:46.043766 23056 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:45:46.044512 23084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:46.044689 23056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:46.044790 23056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "590ca9fe19ec4a2cb334888137c89b86"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "3f3b5289f2be15cc198d5ce3c6a78c19"
server_key_iv: "36598a646935b5b69a5d650a26653c44"
server_key_version: "encryptionkey@0"
I20260811 16:45:46.045136 23056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:46.068274 23056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:46.070930 23056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:46.071055 23056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:46.071255 23056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:46.071589 23056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:46.071627 23056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:46.071676 23056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:46.071703 23056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:46.077989 23056 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:44597
I20260811 16:45:46.078042 23277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:44597 every 8 connection(s)
I20260811 16:45:46.078397 23056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
Aug 11 16:45:46 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466746, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:46.086524 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 23056
I20260811 16:45:46.086818 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:40313
--local_ip_for_outbound_sockets=127.27.186.67
--tserver_master_addrs=127.27.186.126:39941
--webserver_port=43493
--webserver_interface=127.27.186.67
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:45:46.088124 23051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.079154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:36775 (local address 127.27.186.126:39941)
0811 16:45:46.079223 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.079225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.079479 (+ 254us) server_negotiation.cc:407] Connection header received
0811 16:45:46.079995 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.079996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.080009 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.080055 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:46.081029 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.081706 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.082692 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.082893 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.082948 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.085104 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:46.085105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:46.085106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:46.085113 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:46.086673 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:46.087163 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:46.087163 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:46.087164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:46.087215 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:46.087507 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:46.087508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:46.087508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:46.087607 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:46.087657 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.087977 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.088059 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:45:46.088424 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.079132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:36775)
0811 16:45:46.079321 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:46.079365 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:46.079887 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:46.080142 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:46.080145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:46.080710 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:46.080898 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.080903 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.081789 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.081790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.082590 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.082592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.082982 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.082982 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.083085 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.083563 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:46.083572 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:46.085013 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:46.086747 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:46.086755 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:46.086757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:46.087085 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:46.087286 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:46.087286 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:46.087287 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:46.087429 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:46.087673 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:46.087679 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:46.087846 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 16:45:46.087961 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 16:45:46.088141 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":111,"threads_started":1}
I20260811 16:45:46.089012 23278 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39941
I20260811 16:45:46.089113 23278 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:46.089318 23278 heartbeater.cc:511] Master 127.27.186.126:39941 requested a full tablet report, sending...
I20260811 16:45:46.089726 22729 ts_manager.cc:194] Registered new tserver with Master: 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597)
I20260811 16:45:46.090119 22729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:36775
W20260811 16:45:46.172797 23285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:45:46.173079 23285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:45:46.173120 23285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:45:46.174299 23285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:45:46.174340 23285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:45:46.174368 23285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:45:46.175823 23285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:40313
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=43493
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:45:46.176033 23285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:45:46.176220 23285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:45:46.181360 23294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:46.181365 23296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:45:46.181563 23293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:45:46.181732 23285 server_base.cc:1034] running on GCE node
I20260811 16:45:46.181953 23285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:45:46.182250 23285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:45:46.183424 23285 hybrid_clock.cc:648] HybridClock initialized: now 1786466746183416 us; error 38 us; skew 500 ppm
Aug 11 16:45:46 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466746, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:45:46.185993 23285 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:45:46.186510 23285 webserver.cc:460] Webserver started at http://127.27.186.67:43493/ using document root <none> and password file <none>
I20260811 16:45:46.186753 23285 fs_manager.cc:359] Metadata directory not provided
I20260811 16:45:46.186838 23285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:45:46.188189 23285 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 16:45:46.188874 23308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:46.189065 23285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:45:46.189168 23285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "8055115f5a4c4e21bd8142140c28ea3d"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "0dec28ed13944781a70b2aa14b0c6523"
server_key_iv: "6d4f3c44f9c4d04e4679bc459e132c6f"
server_key_version: "encryptionkey@0"
I20260811 16:45:46.189599 23285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:45:46.210074 23285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:45:46.212229 23285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:45:46.212441 23285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:45:46.212715 23285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:45:46.213054 23285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:45:46.213112 23285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:46.213150 23285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:45:46.213197 23285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:45:46.219419 23285 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:40313
I20260811 16:45:46.219477 23519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:40313 every 8 connection(s)
I20260811 16:45:46.219823 23285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:45:46.223831 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 23285
Aug 11 16:45:46 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466746, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:45:46.230659 23051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.220534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:48395 (local address 127.27.186.126:39941)
0811 16:45:46.220585 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.220587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.220833 (+ 246us) server_negotiation.cc:407] Connection header received
0811 16:45:46.221397 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.221398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.221411 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.221469 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:46.222511 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.223007 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.224033 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.224288 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.224400 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.226852 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:46.226854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:46.226854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:46.226861 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:46.228698 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:46.229379 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:46.229380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:46.229380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:46.229448 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:46.229822 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:46.229823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:46.229823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:46.229965 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:46.230054 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.230462 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.230589 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:45:46.230934 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.220501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:48395)
0811 16:45:46.220657 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:46.220729 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:46.221284 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:46.221572 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:46.221576 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:46.222190 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:45:46.222391 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.222397 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.223120 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.223122 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.223921 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.223923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.224414 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.224415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.224573 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.225109 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:45:46.225120 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:45:46.226760 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:45:46.228837 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:46.228847 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:46.228849 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:46.229247 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:46.229582 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:45:46.229583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:45:46.229584 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:45:46.229741 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:45:46.230071 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:45:46.230080 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:45:46.230306 (+ 226us) client_negotiation.cc:769] Sending connection context
0811 16:45:46.230455 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 16:45:46.230665 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260811 16:45:46.231498 23522 heartbeater.cc:347] Connected to a master server at 127.27.186.126:39941
I20260811 16:45:46.231612 23522 heartbeater.cc:464] Registering TS with master...
I20260811 16:45:46.231839 23522 heartbeater.cc:511] Master 127.27.186.126:39941 requested a full tablet report, sending...
I20260811 16:45:46.232295 22729 ts_manager.cc:194] Registered new tserver with Master: 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313)
I20260811 16:45:46.232296 23527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.224275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34022 (local address 127.27.186.126:39941)
0811 16:45:46.224411 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.224413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.224501 (+ 88us) server_negotiation.cc:407] Connection header received
0811 16:45:46.224562 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.224563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.224572 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.224625 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:46.225380 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.225969 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.226776 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.227012 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.227068 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.228845 (+ 1777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:46.228847 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:46.228848 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:46.228856 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:46.230834 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:46.231269 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:46.231270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:46.231271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:46.231334 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:46.231673 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:46.231674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:46.231674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:46.231799 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:46.231991 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.232108 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.232198 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260811 16:45:46.232831 22729 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:48395
I20260811 16:45:46.233387 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:45:46.235843 23527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.233784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34034 (local address 127.27.186.126:39941)
0811 16:45:46.233828 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.233830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.233929 (+ 99us) server_negotiation.cc:407] Connection header received
0811 16:45:46.233997 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.233998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.234026 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.234085 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:45:46.234165 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.234601 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.235296 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.235478 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.235531 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.235659 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:45:46.235698 (+ 39us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 16:45:46.235802 (+ 104us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34034: token expired
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:45:46.235919 23527 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34034: token expired
W20260811 16:45:46.236117 22609 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.27.186.126:39941)
I20260811 16:45:46.242110 23527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.236327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34042 (local address 127.27.186.126:39941)
0811 16:45:46.236376 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.236378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.236388 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:45:46.236410 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.236411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.236419 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.236474 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:45:46.236947 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.237382 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.238105 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.238284 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.238363 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.239514 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:45:46.239516 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:45:46.239517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:45:46.239523 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:45:46.240821 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:46.241215 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:46.241216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:46.241217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:46.241274 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:45:46.241524 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:45:46.241524 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:45:46.241525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:45:46.241673 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:45:46.241780 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.241935 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.242012 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:45:46.243220 22729 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:45:46.244823 22729 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:45:46.247128 22934 tablet_service.cc:1467] Processing CreateTablet for tablet 01da3b11fb9041d69874ce73330eac8c (DEFAULT_TABLE table=test-table [id=3e442b0ba90243e9a60aa6d00700d6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:46.247376 22934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01da3b11fb9041d69874ce73330eac8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:46.249028 22861 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Bootstrap starting.
I20260811 16:45:46.249396 22861 tablet_bootstrap.cc:654] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:46.250073 22861 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: No bootstrap required, opened a new log
I20260811 16:45:46.250129 22861 ts_tablet_manager.cc:1397] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 16:45:46.250250 22861 raft_consensus.cc:348] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.250345 22861 raft_consensus.cc:374] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:46.250399 22861 raft_consensus.cc:729] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef163caa4ad448cb154b304a3b4a293, State: Initialized, Role: FOLLOWER
I20260811 16:45:46.250448 22861 consensus_queue.cc:260] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.250542 22861 ts_tablet_manager.cc:1428] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 16:45:46.250983 23529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.246905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40313 (local address 127.0.0.1:56930)
0811 16:45:46.247095 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:46.247106 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:46.247155 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:46.247553 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:46.247554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:46.247556 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:46.247604 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.247605 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.248645 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.248646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.249817 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.249819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.250743 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.250744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.250805 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.250810 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:45:46.250870 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:45:46.250913 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":110,"threads_started":1}
I20260811 16:45:46.251078 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.247150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56930 (local address 127.27.186.67:40313)
0811 16:45:46.247351 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.247356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.247370 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:45:46.247402 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.247403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.247416 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.247554 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:46.247678 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.248563 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.249909 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.250629 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.250738 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.250802 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.250925 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.250966 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":117,"threads_started":1}
I20260811 16:45:46.251281 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.246806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:44597 (local address 127.0.0.1:42750)
0811 16:45:46.246862 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:46.246876 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:46.246920 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:46.247602 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:46.247603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:46.247605 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:46.247645 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.247646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.249002 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.249003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.250121 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.250124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.251077 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.251078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.251140 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.251144 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:45:46.251175 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 16:45:46.251219 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 16:45:46.251644 23532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.247052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42750 (local address 127.27.186.66:44597)
0811 16:45:46.247408 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.247413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.247425 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:45:46.247469 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.247471 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.247487 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.247720 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:46.247809 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.248888 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.250233 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.250977 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.251423 (+ 446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.251492 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.251520 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.251564 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":93,"threads_started":1}
I20260811 16:45:46.252003 23401 tablet_service.cc:1467] Processing CreateTablet for tablet 01da3b11fb9041d69874ce73330eac8c (DEFAULT_TABLE table=test-table [id=3e442b0ba90243e9a60aa6d00700d6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:46.252326 23401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01da3b11fb9041d69874ce73330eac8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:46.252290 23171 tablet_service.cc:1467] Processing CreateTablet for tablet 01da3b11fb9041d69874ce73330eac8c (DEFAULT_TABLE table=test-table [id=3e442b0ba90243e9a60aa6d00700d6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:45:46.252635 23171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01da3b11fb9041d69874ce73330eac8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:45:46.255429 23536 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: Bootstrap starting.
I20260811 16:45:46.255570 23539 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Bootstrap starting.
I20260811 16:45:46.256124 23536 tablet_bootstrap.cc:654] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:46.256219 23539 tablet_bootstrap.cc:654] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Neither blocks nor log segments found. Creating new log.
I20260811 16:45:46.256676 23536 log.cc:824] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:46.256709 23539 log.cc:824] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Log is configured to *not* fsync() on all Append() calls
I20260811 16:45:46.257421 23536 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: No bootstrap required, opened a new log
I20260811 16:45:46.257426 23539 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: No bootstrap required, opened a new log
I20260811 16:45:46.257527 23536 ts_tablet_manager.cc:1397] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:45:46.257546 23539 ts_tablet_manager.cc:1397] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:45:46.259112 23539 raft_consensus.cc:348] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.259166 23536 raft_consensus.cc:348] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.259281 23539 raft_consensus.cc:374] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:46.259294 23536 raft_consensus.cc:374] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:45:46.259331 23539 raft_consensus.cc:729] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ca9fe19ec4a2cb334888137c89b86, State: Initialized, Role: FOLLOWER
I20260811 16:45:46.259361 23536 raft_consensus.cc:729] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8055115f5a4c4e21bd8142140c28ea3d, State: Initialized, Role: FOLLOWER
I20260811 16:45:46.259447 23539 consensus_queue.cc:260] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.259481 23536 consensus_queue.cc:260] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.259747 23539 ts_tablet_manager.cc:1428] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:45:46.259769 23278 heartbeater.cc:503] Master 127.27.186.126:39941 was elected leader, sending a full tablet report...
I20260811 16:45:46.259851 23522 heartbeater.cc:503] Master 127.27.186.126:39941 was elected leader, sending a full tablet report...
I20260811 16:45:46.260095 23536 ts_tablet_manager.cc:1428] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260811 16:45:46.328994 23282 tablet.cc:2369] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:45:46.371030 23546 raft_consensus.cc:482] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:45:46.371170 23546 raft_consensus.cc:504] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.371654 23546 leader_election.cc:288] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597), 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507)
I20260811 16:45:46.375648 23532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.371898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:49593 (local address 127.27.186.66:44597)
0811 16:45:46.371944 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.371946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.371956 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:45:46.372054 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.372055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.372064 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.372117 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:46.372330 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.373108 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.374683 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.375266 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.375349 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.375358 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.375531 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.375577 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:45:46.375648 23060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.371937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:59095 (local address 127.27.186.65:34507)
0811 16:45:46.371986 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.371988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.372163 (+ 175us) server_negotiation.cc:407] Connection header received
0811 16:45:46.372199 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.372200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.372212 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.372267 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:45:46.372440 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.373145 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.374685 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.375266 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.375349 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.375358 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.375531 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.375577 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:45:46.375649 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.371827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:44597 (local address 127.27.186.67:49593)
0811 16:45:46.371904 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:46.371917 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:46.371966 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:46.372147 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:46.372148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:46.372150 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:46.372234 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.372236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.373211 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.373212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.374574 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.374577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.375360 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.375361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.375444 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.375446 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:45:46.375521 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 16:45:46.375550 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":53}
I20260811 16:45:46.375660 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.371859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:34507 (local address 127.27.186.67:59095)
0811 16:45:46.372054 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:46.372064 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:45:46.372147 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:45:46.372292 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:45:46.372293 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:45:46.372295 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:45:46.372357 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.372358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.373219 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.373220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.374574 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:45:46.374577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.375361 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.375361 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:45:46.375440 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.375445 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:45:46.375505 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:45:46.375550 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":50,"thread_start_us":118,"threads_started":1}
I20260811 16:45:46.376070 23204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01da3b11fb9041d69874ce73330eac8c" candidate_uuid: "8055115f5a4c4e21bd8142140c28ea3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ca9fe19ec4a2cb334888137c89b86" is_pre_election: true
I20260811 16:45:46.376237 23204 raft_consensus.cc:2454] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8055115f5a4c4e21bd8142140c28ea3d in term 0.
I20260811 16:45:46.376494 23317 leader_election.cc:302] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ca9fe19ec4a2cb334888137c89b86, 8055115f5a4c4e21bd8142140c28ea3d; no voters:
I20260811 16:45:46.376634 23546 raft_consensus.cc:2781] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:45:46.376611 22967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01da3b11fb9041d69874ce73330eac8c" candidate_uuid: "8055115f5a4c4e21bd8142140c28ea3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef163caa4ad448cb154b304a3b4a293" is_pre_election: true
I20260811 16:45:46.376699 23546 raft_consensus.cc:482] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:45:46.376737 23546 raft_consensus.cc:3037] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:46.376791 22967 raft_consensus.cc:2454] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8055115f5a4c4e21bd8142140c28ea3d in term 0.
I20260811 16:45:46.377635 23546 raft_consensus.cc:504] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.377790 23546 leader_election.cc:288] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [CANDIDATE]: Term 1 election: Requested vote from peers 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597), 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507)
I20260811 16:45:46.377977 22967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01da3b11fb9041d69874ce73330eac8c" candidate_uuid: "8055115f5a4c4e21bd8142140c28ea3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ef163caa4ad448cb154b304a3b4a293"
I20260811 16:45:46.378074 22967 raft_consensus.cc:3037] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:46.378051 23204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01da3b11fb9041d69874ce73330eac8c" candidate_uuid: "8055115f5a4c4e21bd8142140c28ea3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ca9fe19ec4a2cb334888137c89b86"
I20260811 16:45:46.378153 23204 raft_consensus.cc:3037] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:45:46.378825 22967 raft_consensus.cc:2454] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8055115f5a4c4e21bd8142140c28ea3d in term 1.
I20260811 16:45:46.378945 23204 raft_consensus.cc:2454] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8055115f5a4c4e21bd8142140c28ea3d in term 1.
I20260811 16:45:46.379065 23315 leader_election.cc:302] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ef163caa4ad448cb154b304a3b4a293, 8055115f5a4c4e21bd8142140c28ea3d; no voters:
I20260811 16:45:46.379175 23546 raft_consensus.cc:2781] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:45:46.379356 23546 raft_consensus.cc:686] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 1 LEADER]: Becoming Leader. State: Replica: 8055115f5a4c4e21bd8142140c28ea3d, State: Running, Role: LEADER
I20260811 16:45:46.379433 23546 consensus_queue.cc:237] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:45:46.380281 22729 catalog_manager.cc:5495] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67). New cstate: current_term: 1 leader_uuid: "8055115f5a4c4e21bd8142140c28ea3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } health_report { overall_health: UNKNOWN } } }
I20260811 16:45:46.398567 23534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.396175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56940 (local address 127.27.186.67:40313)
0811 16:45:46.396225 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:45:46.396227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:45:46.396236 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:45:46.396276 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:45:46.396276 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:45:46.396292 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:45:46.396357 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:45:46.396469 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.396924 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.397726 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:45:46.397909 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:45:46.398008 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:45:46.398208 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:45:46.398307 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:45:46.398396 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 16:45:46.398438 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 16:45:46.398457 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:45:46.400504 22967 raft_consensus.cc:1261] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Refusing update from remote peer 8055115f5a4c4e21bd8142140c28ea3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:46.400525 23204 raft_consensus.cc:1261] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 1 FOLLOWER]: Refusing update from remote peer 8055115f5a4c4e21bd8142140c28ea3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:45:46.400825 23546 consensus_queue.cc:1035] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:46.400990 23549 consensus_queue.cc:1035] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:45:46.403045 23551 mvcc.cc:205] Tried to move back new op lower bound from 7317367793253326848 to 7317367793170882560. Current Snapshot: MvccSnapshot[applied={T|T < 7317367793253326848}]
I20260811 16:45:46.403287 23552 mvcc.cc:205] Tried to move back new op lower bound from 7317367793253326848 to 7317367793170882560. Current Snapshot: MvccSnapshot[applied={T|T < 7317367793253326848}]
I20260811 16:45:46.405992 22729 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:45:46.406108 22729 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:45:46.406847 22729 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Sending DeleteTablet for 3 replicas of tablet 01da3b11fb9041d69874ce73330eac8c
I20260811 16:45:46.407159 22934 tablet_service.cc:1514] Processing DeleteTablet for tablet 01da3b11fb9041d69874ce73330eac8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:46 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:46934
I20260811 16:45:46.407184 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 22791
I20260811 16:45:46.407203 23171 tablet_service.cc:1514] Processing DeleteTablet for tablet 01da3b11fb9041d69874ce73330eac8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:46 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:42750
I20260811 16:45:46.407253 23061 tablet_replica.cc:330] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: stopping tablet replica
I20260811 16:45:46.407297 23061 raft_consensus.cc:2229] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:46.407347 23061 raft_consensus.cc:2258] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:46.417565 23401 tablet_service.cc:1514] Processing DeleteTablet for tablet 01da3b11fb9041d69874ce73330eac8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:45:46 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:56930
I20260811 16:45:46.424867 23570 tablet_replica.cc:330] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: stopping tablet replica
I20260811 16:45:46.425058 23570 raft_consensus.cc:2229] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:45:46.425220 23570 raft_consensus.cc:2258] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:46.427024 23570 ts_tablet_manager.cc:1905] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:46.429595 23570 ts_tablet_manager.cc:1918] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:46.429690 23570 log.cc:1196] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/01da3b11fb9041d69874ce73330eac8c
I20260811 16:45:46.430138 23570 ts_tablet_manager.cc:1939] T 01da3b11fb9041d69874ce73330eac8c P 8055115f5a4c4e21bd8142140c28ea3d: Deleting consensus metadata
I20260811 16:45:46.430658 22709 catalog_manager.cc:4841] TS 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313): tablet 01da3b11fb9041d69874ce73330eac8c (table test-table [id=3e442b0ba90243e9a60aa6d00700d6f6]) successfully deleted
I20260811 16:45:46.435667 23569 tablet_replica.cc:330] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: stopping tablet replica
I20260811 16:45:46.435876 23569 raft_consensus.cc:2229] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:45:46.436046 23569 raft_consensus.cc:2258] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:45:46.436669 23569 ts_tablet_manager.cc:1905] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:45:46.438766 23569 ts_tablet_manager.cc:1918] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:45:46.438856 23569 log.cc:1196] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/01da3b11fb9041d69874ce73330eac8c
I20260811 16:45:46.439146 23569 ts_tablet_manager.cc:1939] T 01da3b11fb9041d69874ce73330eac8c P 590ca9fe19ec4a2cb334888137c89b86: Deleting consensus metadata
I20260811 16:45:46.439669 22713 catalog_manager.cc:4841] TS 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597): tablet 01da3b11fb9041d69874ce73330eac8c (table test-table [id=3e442b0ba90243e9a60aa6d00700d6f6]) successfully deleted
W20260811 16:45:46.440661 22712 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:34507 (error 108)
I20260811 16:45:46.441150 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 23056
I20260811 16:45:46.441233 23059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:45:46.441062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:34507 (local address 127.0.0.1:46948)
0811 16:45:46.441133 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 16:45:46.441189 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:34507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 16:45:46.443164 22712 catalog_manager.cc:4584] TS 4ef163caa4ad448cb154b304a3b4a293 (127.27.186.65:34507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 01da3b11fb9041d69874ce73330eac8c: Network error: Client connection negotiation failed: client connection to 127.27.186.65:34507: connect: Connection refused (error 111)
I20260811 16:45:46.452714 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 23285
I20260811 16:45:46.472150 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 22683
I20260811 16:46:06.492798 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39941
--webserver_interface=127.27.186.126
--webserver_port=35719
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:39941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:06.577282 23573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:06.577574 23573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:06.577605 23573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:06.578758 23573 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 16:46:06.578801 23573 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 16:46:06.578815 23573 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 16:46:06.578826 23573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:06.578840 23573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:06.578852 23573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:06.578864 23573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:06.578923 23573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:06.580431 23573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:39941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:39941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=35719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:06.580691 23573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:06.580966 23573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:46:06.586480 23573 server_base.cc:1034] running on GCE node
W20260811 16:46:06.586418 23585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:06.586440 23589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:06.586409 23581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:06.586920 23573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:06.587222 23573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:06.588375 23573 hybrid_clock.cc:648] HybridClock initialized: now 1786466766588361 us; error 30 us; skew 500 ppm
Aug 11 16:46:06 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466766, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:06.591068 23573 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:06.591606 23573 webserver.cc:460] Webserver started at http://127.27.186.126:35719/ using document root <none> and password file <none>
I20260811 16:46:06.591799 23573 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:06.591840 23573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:06.593187 23573 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:06.593923 23599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:06.594159 23573 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:46:06.594236 23573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "448cc46df3ad44148517ac98346953e6"
format_stamp: "Formatted at 2026-08-11 16:45:24 on dist-test-slave-gsp7"
server_key: "3247707deca032568f49c5866500911f"
server_key_iv: "2d955ed3080b7d53d44435ad204df834"
server_key_version: "encryptionkey@0"
I20260811 16:46:06.594587 23573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:06.626263 23573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:06.628322 23573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:06.628491 23573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:06.633018 23573 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:39941
I20260811 16:46:06.633095 23684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:39941 every 8 connection(s)
I20260811 16:46:06.633577 23573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:06.635298 23685 sys_catalog.cc:263] Verifying existing consensus state
I20260811 16:46:06.635972 23685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Bootstrap starting.
I20260811 16:46:06.639384 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 23573
I20260811 16:46:06.639696 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:34507
--local_ip_for_outbound_sockets=127.27.186.65
--tserver_master_addrs=127.27.186.126:39941
--webserver_port=37927
--webserver_interface=127.27.186.65
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:46:06.645720 23685 log.cc:824] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:06.648216 23685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:46:06.648566 23685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Bootstrap complete.
I20260811 16:46:06.651147 23685 raft_consensus.cc:348] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:46:06.651422 23685 raft_consensus.cc:729] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448cc46df3ad44148517ac98346953e6, State: Initialized, Role: FOLLOWER
I20260811 16:46:06.651659 23685 consensus_queue.cc:260] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:46:06.651769 23685 raft_consensus.cc:388] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:06.651830 23685 raft_consensus.cc:482] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:06.651885 23685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 2 FOLLOWER]: Advancing to term 3
I20260811 16:46:06.652973 23685 raft_consensus.cc:504] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:46:06.653102 23685 leader_election.cc:302] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 448cc46df3ad44148517ac98346953e6; no voters:
I20260811 16:46:06.653321 23685 leader_election.cc:288] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 16:46:06.653394 23693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 16:46:06.653602 23693 raft_consensus.cc:686] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [term 3 LEADER]: Becoming Leader. State: Replica: 448cc46df3ad44148517ac98346953e6, State: Running, Role: LEADER
I20260811 16:46:06.653646 23685 sys_catalog.cc:564] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:06.653707 23693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } }
I20260811 16:46:06.654062 23693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 448cc46df3ad44148517ac98346953e6. Latest consensus state: current_term: 3 leader_uuid: "448cc46df3ad44148517ac98346953e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } } }
I20260811 16:46:06.654181 23693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:06.654063 23695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "448cc46df3ad44148517ac98346953e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448cc46df3ad44148517ac98346953e6" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 39941 } } }
I20260811 16:46:06.654374 23695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:06.654740 23703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:06.655534 23703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:06.655758 23703 catalog_manager.cc:1259] Loaded cluster ID: 4e9fe765114d466a8be9178b5097aad7
I20260811 16:46:06.655910 23703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:06.657217 23703 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:06.657405 23703 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Loaded TSK: 0
I20260811 16:46:06.657450 23703 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 448cc46df3ad44148517ac98346953e6: Loaded TSK: 1
F20260811 16:46:06.657753 23703 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd98d88a9ad google::LogMessage::Fail() at ??:0
@ 0x7fd98d88d88a google::LogMessage::SendToLog() at ??:0
@ 0x7fd98d88a4de google::LogMessage::Flush() at ??:0
@ 0x7fd98d88ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd98fff7104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fd98fff4d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fd9957e41cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fd9957e448e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fd9957e4594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fd9957aac48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fd9957b4ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd98f7580d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd98f74d954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd9905b16db start_thread at ??:0
@ 0x7fd98c38861f clone at ??:0
W20260811 16:46:06.764114 23688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:06.764338 23688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:06.764364 23688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:06.765729 23688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:06.765774 23688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:06.765811 23688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:46:06.767391 23688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:34507
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=37927
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:06.767642 23688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:06.767926 23688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:06.774238 23763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:06.774353 23762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:06.774538 23688 server_base.cc:1034] running on GCE node
W20260811 16:46:06.774263 23766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:06.774843 23688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:06.775120 23688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:06.776304 23688 hybrid_clock.cc:648] HybridClock initialized: now 1786466766776285 us; error 33 us; skew 500 ppm
Aug 11 16:46:06 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466766, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:06.778995 23688 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:46:06.779491 23688 webserver.cc:460] Webserver started at http://127.27.186.65:37927/ using document root <none> and password file <none>
I20260811 16:46:06.779723 23688 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:06.779795 23688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:06.781246 23688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:06.782056 23774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:06.782238 23688 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 16:46:06.782343 23688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "4ef163caa4ad448cb154b304a3b4a293"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "4c12e243f735ecd5db7f8228e5bc8487"
server_key_iv: "1317359e58b1462ea015158a00dd4dde"
server_key_version: "encryptionkey@0"
I20260811 16:46:06.782733 23688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:06.797627 23688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:06.799876 23688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:06.800045 23688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:06.800280 23688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:06.800800 23786 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 16:46:06.802837 23688 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 16:46:06.802932 23688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 16:46:06.802986 23688 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 16:46:06.803743 23688 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 16:46:06.803814 23688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 16:46:06.803880 23786 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Bootstrap starting.
I20260811 16:46:06.812480 23688 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:34507
I20260811 16:46:06.812526 23961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:34507 every 8 connection(s)
I20260811 16:46:06.812937 23688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:46:06.817261 23786 log.cc:824] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:06.820340 23786 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 16:46:06.820700 23786 tablet_bootstrap.cc:492] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Bootstrap complete.
I20260811 16:46:06.820993 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 23688
I20260811 16:46:06.821273 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:44597
--local_ip_for_outbound_sockets=127.27.186.66
--tserver_master_addrs=127.27.186.126:39941
--webserver_port=36623
--webserver_interface=127.27.186.66
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:46:06.822268 23786 ts_tablet_manager.cc:1397] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.011s
I20260811 16:46:06.823864 23786 raft_consensus.cc:348] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:46:06.824220 23786 raft_consensus.cc:729] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ef163caa4ad448cb154b304a3b4a293, State: Initialized, Role: FOLLOWER
I20260811 16:46:06.824407 23786 consensus_queue.cc:260] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:46:06.824692 23786 ts_tablet_manager.cc:1428] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260811 16:46:06.883961 23964 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:46:06.813672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:59199)
0811 16:46:06.813862 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:06.813909 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:06.814410 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:06.883748 (+ 69338us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
W20260811 16:46:06.884210 23962 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:39941 (0 consecutive failures): Network error: Failed to ping master at 127.27.186.126:39941: Client connection negotiation failed: client connection to 127.27.186.126:39941: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 16:46:06.884578 23964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:06.884439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:56289)
0811 16:46:06.884507 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:06.884556 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 16:46:06.884979 23964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:06.884868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:56457)
0811 16:46:06.884920 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:06.884944 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:46:06.885103 23962 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 16:46:06.912362 23966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:06.912575 23966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:06.912604 23966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:06.913936 23966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:06.913981 23966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:06.914011 23966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:46:06.915535 23966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:44597
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=36623
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:06.915800 23966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:06.916043 23966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:46:06.921200 23966 server_base.cc:1034] running on GCE node
W20260811 16:46:06.921245 23978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:06.921334 23983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:06.921217 23980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:06.921695 23966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:06.921938 23966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:06.923110 23966 hybrid_clock.cc:648] HybridClock initialized: now 1786466766923099 us; error 43 us; skew 500 ppm
Aug 11 16:46:06 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466766, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:06.926201 23966 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:46:06.926627 23966 webserver.cc:460] Webserver started at http://127.27.186.66:36623/ using document root <none> and password file <none>
I20260811 16:46:06.926826 23966 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:06.926869 23966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:06.928277 23966 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:06.928892 23993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:06.929106 23966 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:06.929214 23966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "590ca9fe19ec4a2cb334888137c89b86"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "3f3b5289f2be15cc198d5ce3c6a78c19"
server_key_iv: "36598a646935b5b69a5d650a26653c44"
server_key_version: "encryptionkey@0"
I20260811 16:46:06.929674 23966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:06.952412 23966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:06.954910 23966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:06.955092 23966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:06.955341 23966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:06.955662 23966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:06.955718 23966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:06.955761 23966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:06.955792 23966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:06.962268 23966 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:44597
I20260811 16:46:06.962316 24179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:44597 every 8 connection(s)
I20260811 16:46:06.962679 23966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:46:06.963795 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:06.963358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:37713)
0811 16:46:06.963547 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:06.963644 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":74,"threads_started":1}
W20260811 16:46:06.964210 24185 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:39941 (0 consecutive failures): Network error: Failed to ping master at 127.27.186.126:39941: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
I20260811 16:46:06.964515 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:06.964408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:59243)
0811 16:46:06.964460 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:06.964496 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:46:06.964805 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:06.964717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:58081)
0811 16:46:06.964761 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:06.964783 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 16:46:06.964924 24185 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:46:06.970234 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 23966
I20260811 16:46:06.970533 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:40313
--local_ip_for_outbound_sockets=127.27.186.67
--tserver_master_addrs=127.27.186.126:39941
--webserver_port=43493
--webserver_interface=127.27.186.67
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:45967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:07.056578 24191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:07.056792 24191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:07.056818 24191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:07.058056 24191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:07.058101 24191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:07.058130 24191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:46:07.059638 24191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:40313
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=43493
--tserver_master_addrs=127.27.186.126:39941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:07.059898 24191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:07.060155 24191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:07.065451 24197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:07.065418 24191 server_base.cc:1034] running on GCE node
W20260811 16:46:07.065397 24196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:07.065428 24200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:07.066002 24191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:07.066345 24191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:07.067569 24191 hybrid_clock.cc:648] HybridClock initialized: now 1786466767067541 us; error 39 us; skew 500 ppm
Aug 11 16:46:07 dist-test-slave-gsp7 krb5kdc[21790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466767, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:07.070502 24191 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:46:07.071079 24191 webserver.cc:460] Webserver started at http://127.27.186.67:43493/ using document root <none> and password file <none>
I20260811 16:46:07.071346 24191 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:07.071425 24191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:07.073004 24191 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:46:07.073758 24209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:07.073954 24191 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:07.074077 24191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "8055115f5a4c4e21bd8142140c28ea3d"
format_stamp: "Formatted at 2026-08-11 16:45:25 on dist-test-slave-gsp7"
server_key: "0dec28ed13944781a70b2aa14b0c6523"
server_key_iv: "6d4f3c44f9c4d04e4679bc459e132c6f"
server_key_version: "encryptionkey@0"
I20260811 16:46:07.074479 24191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:07.101980 24191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:07.104153 24191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:07.104351 24191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:07.104622 24191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:07.104943 24191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:07.105000 24191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:07.105041 24191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:07.105069 24191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:07.111794 24191 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:40313
I20260811 16:46:07.111879 24399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:40313 every 8 connection(s)
I20260811 16:46:07.112218 24191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:46:07.113411 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.112897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:53465)
0811 16:46:07.113101 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:07.113230 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":103,"threads_started":1}
W20260811 16:46:07.113875 24400 heartbeater.cc:644] Failed to heartbeat to 127.27.186.126:39941 (0 consecutive failures): Network error: Failed to ping master at 127.27.186.126:39941: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
I20260811 16:46:07.114212 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.114115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:36315)
0811 16:46:07.114164 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:07.114192 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:46:07.114647 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.114566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:44049)
0811 16:46:07.114598 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:07.114626 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 16:46:07.114799 24400 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 16:46:07.116858 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 24191
I20260811 16:46:07.885815 24405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.885548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:58867)
0811 16:46:07.885698 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:07.885748 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":60,"threads_started":1}
I20260811 16:46:07.965595 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.965256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:35223)
0811 16:46:07.965407 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:07.965461 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":57,"threads_started":1}
I20260811 16:46:07.982381 24408 raft_consensus.cc:482] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:07.982514 24408 raft_consensus.cc:504] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:46:07.982920 24408 leader_election.cc:288] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597), 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313)
Aug 11 16:46:07 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466766, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.66@KRBTEST.COM
Aug 11 16:46:07 dist-test-slave-gsp7 krb5kdc[21790](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466766, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.67@KRBTEST.COM
I20260811 16:46:07.994331 24410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.983231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:55947 (local address 127.27.186.67:40313)
0811 16:46:07.983367 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:07.983380 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:07.983408 (+ 28us) server_negotiation.cc:407] Connection header received
0811 16:46:07.983846 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:07.983848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:07.983900 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:07.984012 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:07.985113 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:07.986260 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:07.987261 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:07.987652 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:07.987735 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:07.990517 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:07.990520 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:07.990520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:07.990530 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:07.992385 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:07.992925 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:07.992929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:07.992929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:07.993060 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:07.993430 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:07.993431 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:07.993432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:07.993716 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:07.993813 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:07.994095 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 16:46:07.994219 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":74,"threads_started":1}
I20260811 16:46:07.994331 24409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.983217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:44597 (local address 127.27.186.65:34301)
0811 16:46:07.983393 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:07.983407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:07.983471 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:07.984340 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:07.984341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:07.984661 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:07.984979 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:07.984985 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:07.986281 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:07.986282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:07.987147 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:07.987150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:07.987798 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:07.987799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:07.987872 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:07.988380 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:07.988387 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:07.989940 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:07.992733 (+ 2793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:07.992734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:07.992734 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:07.992964 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:07.993263 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:07.993263 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:07.993264 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:07.993330 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:07.993797 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:07.993804 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:07.993925 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 16:46:07.994040 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 16:46:07.994231 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":1,"thread_start_us":55,"threads_started":1}
I20260811 16:46:07.994386 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.983364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:34301 (local address 127.27.186.66:44597)
0811 16:46:07.983550 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:07.983565 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:07.983594 (+ 29us) server_negotiation.cc:407] Connection header received
0811 16:46:07.984143 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:07.984147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:07.984200 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:07.984359 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:07.985109 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:07.986182 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:07.987238 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:07.987682 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:07.987834 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:07.990102 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:07.990107 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:07.990107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:07.990122 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:07.992641 (+ 2519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:07.993047 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:07.993049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:07.993050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:07.993185 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:07.993404 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:07.993405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:07.993406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:07.993717 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:07.993828 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:07.994104 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 16:46:07.994259 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":82,"threads_started":1}
I20260811 16:46:07.994810 24405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:07.983110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40313 (local address 127.27.186.65:55947)
0811 16:46:07.983174 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:07.983184 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:07.983240 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:07.984090 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:07.984094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:07.984677 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:07.984979 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:07.984985 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:07.986375 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:07.986375 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:07.987149 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:07.987151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:07.987747 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:07.987748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:07.987871 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:07.988554 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:07.988560 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:07.990415 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:07.992473 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:07.992482 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:07.992485 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:07.992845 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:07.993146 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:07.993147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:07.993147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:07.993336 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:07.993798 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:07.993806 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:07.993925 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 16:46:07.994040 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 16:46:07.994326 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":219}
W20260811 16:46:07.995311 23779 leader_election.cc:341] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597): Not found: Tablet not found: 01da3b11fb9041d69874ce73330eac8c
W20260811 16:46:07.995550 23775 leader_election.cc:341] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313): Not found: Tablet not found: 01da3b11fb9041d69874ce73330eac8c
I20260811 16:46:07.995594 23775 leader_election.cc:302] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef163caa4ad448cb154b304a3b4a293; no voters: 590ca9fe19ec4a2cb334888137c89b86, 8055115f5a4c4e21bd8142140c28ea3d
I20260811 16:46:07.995754 24408 raft_consensus.cc:2726] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:46:08.115331 24415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:08.115118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:34009)
0811 16:46:08.115248 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:08.115296 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260811 16:46:08.886595 24416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:08.886321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:58649)
0811 16:46:08.886477 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:08.886526 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":71,"threads_started":1}
I20260811 16:46:08.966359 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:08.966117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:52453)
0811 16:46:08.966271 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:08.966315 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":76,"threads_started":1}
I20260811 16:46:09.116086 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:09.115807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:55197)
0811 16:46:09.115960 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:09.115996 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260811 16:46:09.887306 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:09.887083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:46623)
0811 16:46:09.887215 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:09.887259 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260811 16:46:09.967228 24423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:09.966964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:56153)
0811 16:46:09.967125 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:09.967173 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":72,"threads_started":1}
I20260811 16:46:09.970861 24427 raft_consensus.cc:482] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:09.970963 24427 raft_consensus.cc:504] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:46:09.971195 24427 leader_election.cc:288] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597), 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313)
W20260811 16:46:09.971773 23779 leader_election.cc:341] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597): Not found: Tablet not found: 01da3b11fb9041d69874ce73330eac8c
W20260811 16:46:09.971871 23775 leader_election.cc:341] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313): Not found: Tablet not found: 01da3b11fb9041d69874ce73330eac8c
I20260811 16:46:09.971957 23775 leader_election.cc:302] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef163caa4ad448cb154b304a3b4a293; no voters: 590ca9fe19ec4a2cb334888137c89b86, 8055115f5a4c4e21bd8142140c28ea3d
I20260811 16:46:09.972051 24427 raft_consensus.cc:2726] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:46:10.116847 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:10.116594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:60777)
0811 16:46:10.116744 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:10.116802 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":65,"threads_started":1}
I20260811 16:46:10.888151 24429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:10.887859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:57921)
0811 16:46:10.888049 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:10.888102 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":92,"threads_started":1}
I20260811 16:46:10.967978 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:10.967768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:55869)
0811 16:46:10.967899 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:10.967937 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260811 16:46:11.117656 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:11.117385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:50769)
0811 16:46:11.117580 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:11.117619 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":123,"threads_started":1}
I20260811 16:46:11.889065 24438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:11.888788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:59471)
0811 16:46:11.888958 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:11.889013 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":101,"threads_started":1}
I20260811 16:46:11.968905 24439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:11.968480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:43581)
0811 16:46:11.968792 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:11.968860 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":237,"threads_started":1}
I20260811 16:46:12.118394 24441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:12.118112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:36907)
0811 16:46:12.118287 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:12.118333 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
I20260811 16:46:12.256881 24442 raft_consensus.cc:482] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:12.257010 24442 raft_consensus.cc:504] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:46:12.257200 24442 leader_election.cc:288] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597), 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313)
W20260811 16:46:12.257660 23775 leader_election.cc:341] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313): Not found: Tablet not found: 01da3b11fb9041d69874ce73330eac8c
W20260811 16:46:12.257792 23779 leader_election.cc:341] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597): Not found: Tablet not found: 01da3b11fb9041d69874ce73330eac8c
I20260811 16:46:12.257915 23779 leader_election.cc:302] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef163caa4ad448cb154b304a3b4a293; no voters: 590ca9fe19ec4a2cb334888137c89b86, 8055115f5a4c4e21bd8142140c28ea3d
I20260811 16:46:12.258036 24442 raft_consensus.cc:2726] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:46:12.889853 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:12.889644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:48941)
0811 16:46:12.889772 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:12.889804 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260811 16:46:12.969689 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:12.969389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:58549)
0811 16:46:12.969603 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:12.969643 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":96,"threads_started":1}
I20260811 16:46:13.119131 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:13.118884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:42297)
0811 16:46:13.119034 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:13.119081 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":63,"threads_started":1}
I20260811 16:46:13.890715 24446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:13.890438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:43177)
0811 16:46:13.890577 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:13.890649 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
I20260811 16:46:13.970373 24447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:13.970170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:50845)
0811 16:46:13.970295 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:13.970329 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260811 16:46:14.120011 24449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:14.119759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:39641)
0811 16:46:14.119924 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:14.119965 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":85,"threads_started":1}
I20260811 16:46:14.891474 24450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:14.891248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:46387)
0811 16:46:14.891372 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:14.891410 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260811 16:46:14.971060 24452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:14.970844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:40057)
0811 16:46:14.970971 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:14.971012 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
I20260811 16:46:15.120755 24455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:15.120521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:46601)
0811 16:46:15.120663 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:15.120706 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260811 16:46:15.892202 24456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:15.891953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:41273)
0811 16:46:15.892110 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:15.892155 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260811 16:46:15.971752 24457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:15.971539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:53551)
0811 16:46:15.971667 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:15.971705 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260811 16:46:16.121539 24458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:16.121263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:33459)
0811 16:46:16.121402 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:16.121439 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":67,"threads_started":1}
I20260811 16:46:16.892870 24459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:16.892655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:41295)
0811 16:46:16.892789 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:16.892823 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":69,"threads_started":1}
I20260811 16:46:16.972404 24462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:16.972197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:56041)
0811 16:46:16.972322 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:16.972359 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260811 16:46:17.122255 24463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:17.121987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:46377)
0811 16:46:17.122124 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:17.122187 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260811 16:46:17.292492 24465 raft_consensus.cc:482] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:17.292606 24465 raft_consensus.cc:504] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ca9fe19ec4a2cb334888137c89b86" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 44597 } } peers { permanent_uuid: "8055115f5a4c4e21bd8142140c28ea3d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40313 } } peers { permanent_uuid: "4ef163caa4ad448cb154b304a3b4a293" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 34507 } }
I20260811 16:46:17.292785 24465 leader_election.cc:288] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597), 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313)
W20260811 16:46:17.293198 23779 leader_election.cc:341] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 590ca9fe19ec4a2cb334888137c89b86 (127.27.186.66:44597): Not found: Tablet not found: 01da3b11fb9041d69874ce73330eac8c
W20260811 16:46:17.293267 23775 leader_election.cc:341] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8055115f5a4c4e21bd8142140c28ea3d (127.27.186.67:40313): Not found: Tablet not found: 01da3b11fb9041d69874ce73330eac8c
I20260811 16:46:17.293296 23779 leader_election.cc:302] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ef163caa4ad448cb154b304a3b4a293; no voters: 590ca9fe19ec4a2cb334888137c89b86, 8055115f5a4c4e21bd8142140c28ea3d
I20260811 16:46:17.293398 24465 raft_consensus.cc:2726] T 01da3b11fb9041d69874ce73330eac8c P 4ef163caa4ad448cb154b304a3b4a293 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 16:46:17.893625 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:17.893348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:44501)
0811 16:46:17.893532 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:17.893577 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260811 16:46:17.973145 24467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:17.972877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:46763)
0811 16:46:17.973044 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:17.973083 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":83,"threads_started":1}
I20260811 16:46:18.122892 24470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:18.122690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:56607)
0811 16:46:18.122810 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:18.122847 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260811 16:46:18.894431 24472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:18.894148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:49667)
0811 16:46:18.894330 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:18.894370 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":87,"threads_started":1}
I20260811 16:46:18.973948 24473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:18.973703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:42067)
0811 16:46:18.973860 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:18.973896 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":94,"threads_started":1}
I20260811 16:46:19.123705 24475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:19.123467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:56553)
0811 16:46:19.123613 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:19.123654 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260811 16:46:19.895219 24477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:19.894936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:44789)
0811 16:46:19.895122 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:19.895168 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":95,"threads_started":1}
I20260811 16:46:19.974797 24478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:19.974531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:38435)
0811 16:46:19.974693 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:19.974739 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":87,"threads_started":1}
I20260811 16:46:20.124630 24479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:20.124357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:46607)
0811 16:46:20.124528 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:20.124579 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":64,"threads_started":1}
I20260811 16:46:20.895972 24480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:20.895731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:41317)
0811 16:46:20.895878 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:20.895921 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":67,"threads_started":1}
I20260811 16:46:20.975620 24482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:20.975371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:59225)
0811 16:46:20.975532 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:20.975573 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":71,"threads_started":1}
I20260811 16:46:21.125401 24483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:21.125134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:36141)
0811 16:46:21.125304 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:21.125353 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260811 16:46:21.896840 24484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:21.896614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.65:35685)
0811 16:46:21.896741 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:21.896781 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":75,"threads_started":1}
I20260811 16:46:21.976485 24485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:21.976215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.66:44667)
0811 16:46:21.976384 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:21.976435 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":85,"threads_started":1}
I20260811 16:46:22.121409 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 23688
I20260811 16:46:22.130198 24486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:22.126776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:39941 (local address 127.27.186.67:59203)
0811 16:46:22.130071 (+ 3295us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:22.130128 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.126:39941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3269,"thread_start_us":1268,"threads_started":1}
I20260811 16:46:22.136884 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 23966
I20260811 16:46:22.146538 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 24191
2026-08-11T16:46:22Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58867 ms)
[----------] 30 tests from SecurityITest (248229 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:22 dist-test-slave-gsp7 krb5kdc[24491](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:22 dist-test-slave-gsp7 krb5kdc[24491](info): set up 2 sockets
Aug 11 16:46:22 dist-test-slave-gsp7 krb5kdc[24491](info): commencing operation
krb5kdc: starting...
W20260811 16:46:23.433248 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:23 dist-test-slave-gsp7 krb5kdc[24491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:23.566489 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:42417
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:37005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:42417
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:23.651705 24515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:23.651970 24515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:23.652009 24515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:23.653168 24515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:23.653247 24515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:23.653272 24515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:23.653294 24515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:23.653331 24515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:23.654879 24515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:42417
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:42417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:23.655180 24515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:23.655441 24515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:23.660681 24527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:23.660674 24528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:23.660674 24532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:23.660743 24515 server_base.cc:1034] running on GCE node
I20260811 16:46:23.661191 24515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:23.661605 24515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:23.662756 24515 hybrid_clock.cc:648] HybridClock initialized: now 1786466783662741 us; error 37 us; skew 500 ppm
Aug 11 16:46:23 dist-test-slave-gsp7 krb5kdc[24491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466783, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:23.665727 24515 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:23.666181 24515 webserver.cc:460] Webserver started at http://127.27.186.126:38803/ using document root <none> and password file <none>
I20260811 16:46:23.666445 24515 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:23.666515 24515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:23.666671 24515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:23.667771 24515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "c90a9ce4bb774422b49eb7a997529da7"
format_stamp: "Formatted at 2026-08-11 16:46:23 on dist-test-slave-gsp7"
server_key: "21f25f2b3e980e3e6cda998711613bb5"
server_key_iv: "cd4c66102dca0611a420f74c55c8a05c"
server_key_version: "encryptionkey@0"
I20260811 16:46:23.668166 24515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "c90a9ce4bb774422b49eb7a997529da7"
format_stamp: "Formatted at 2026-08-11 16:46:23 on dist-test-slave-gsp7"
server_key: "21f25f2b3e980e3e6cda998711613bb5"
server_key_iv: "cd4c66102dca0611a420f74c55c8a05c"
server_key_version: "encryptionkey@0"
I20260811 16:46:23.669677 24515 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:23.670572 24545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:23.670768 24515 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:23.670882 24515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "c90a9ce4bb774422b49eb7a997529da7"
format_stamp: "Formatted at 2026-08-11 16:46:23 on dist-test-slave-gsp7"
server_key: "21f25f2b3e980e3e6cda998711613bb5"
server_key_iv: "cd4c66102dca0611a420f74c55c8a05c"
server_key_version: "encryptionkey@0"
I20260811 16:46:23.670969 24515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:23.684890 24515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:23.687409 24515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:23.687592 24515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:23.692242 24515 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:42417
I20260811 16:46:23.692276 24642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:42417 every 8 connection(s)
I20260811 16:46:23.692658 24515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:23.693588 24644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:23.696003 24644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7: Bootstrap starting.
I20260811 16:46:23.696658 24644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:23.696973 24644 log.cc:824] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:23.697827 24644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7: No bootstrap required, opened a new log
I20260811 16:46:23.699580 24644 raft_consensus.cc:348] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90a9ce4bb774422b49eb7a997529da7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42417 } }
I20260811 16:46:23.699738 24644 raft_consensus.cc:374] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:23.699760 24644 raft_consensus.cc:729] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c90a9ce4bb774422b49eb7a997529da7, State: Initialized, Role: FOLLOWER
I20260811 16:46:23.699922 24644 consensus_queue.cc:260] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90a9ce4bb774422b49eb7a997529da7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42417 } }
I20260811 16:46:23.700006 24644 raft_consensus.cc:388] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:23.700031 24644 raft_consensus.cc:482] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:23.700084 24644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:23.700659 24644 raft_consensus.cc:504] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90a9ce4bb774422b49eb7a997529da7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42417 } }
I20260811 16:46:23.700774 24644 leader_election.cc:302] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c90a9ce4bb774422b49eb7a997529da7; no voters:
I20260811 16:46:23.700991 24644 leader_election.cc:288] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:23.701042 24648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:23.701309 24644 sys_catalog.cc:564] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:23.701381 24648 raft_consensus.cc:686] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [term 1 LEADER]: Becoming Leader. State: Replica: c90a9ce4bb774422b49eb7a997529da7, State: Running, Role: LEADER
I20260811 16:46:23.701499 24648 consensus_queue.cc:237] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90a9ce4bb774422b49eb7a997529da7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42417 } }
I20260811 16:46:23.702045 24652 sys_catalog.cc:455] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c90a9ce4bb774422b49eb7a997529da7. Latest consensus state: current_term: 1 leader_uuid: "c90a9ce4bb774422b49eb7a997529da7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90a9ce4bb774422b49eb7a997529da7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42417 } } }
I20260811 16:46:23.702212 24652 sys_catalog.cc:458] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:23.702277 24649 sys_catalog.cc:455] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c90a9ce4bb774422b49eb7a997529da7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90a9ce4bb774422b49eb7a997529da7" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 42417 } } }
I20260811 16:46:23.702425 24649 sys_catalog.cc:458] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:23.702469 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 24515
I20260811 16:46:23.702610 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:23.702858 28393 external_mini_cluster.cc:1428] Setting key 0bd8750114b2241446f0b3ad3b4b119f
I20260811 16:46:23.702862 24660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:23.704037 24660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:23.705578 24660 catalog_manager.cc:1347] Generated new cluster ID: a63ef306a18e4657a189448a3685680b
I20260811 16:46:23.705634 24660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:46:23 dist-test-slave-gsp7 krb5kdc[24491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466783, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:23.715879 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:23.703409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34038 (local address 127.27.186.126:42417)
0811 16:46:23.703726 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:23.703735 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:23.703798 (+ 63us) server_negotiation.cc:407] Connection header received
0811 16:46:23.703923 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:23.703931 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:23.703990 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:23.704144 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:23.705248 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:23.706664 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:23.707796 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:23.708406 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:23.708497 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:23.711676 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:23.711682 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:23.711682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:23.711696 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:23.714043 (+ 2347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:23.714475 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:23.714479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:23.714480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:23.714624 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:23.714850 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:23.714851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:23.714851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:23.715200 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:23.715401 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:23.715478 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 16:46:23.715633 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":92,"threads_started":1}
I20260811 16:46:23.726547 24660 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:23.727136 24660 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:23.737385 24660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7: Generated new TSK 0
I20260811 16:46:23.737677 24660 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:46:23.773660 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:42417
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:37005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:23.862182 24678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:23.862419 24678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:23.862445 24678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:23.863660 24678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:23.863709 24678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:23.863736 24678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:46:23.865424 24678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:42417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:23.865749 24678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:23.866007 24678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:23.871552 24687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:23.871532 24683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:23.871510 24684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:23.871632 24678 server_base.cc:1034] running on GCE node
I20260811 16:46:23.871979 24678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:23.872303 24678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:23.873523 24678 hybrid_clock.cc:648] HybridClock initialized: now 1786466783873448 us; error 47 us; skew 500 ppm
Aug 11 16:46:23 dist-test-slave-gsp7 krb5kdc[24491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466783, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:23.876348 24678 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:46:23.876838 24678 webserver.cc:460] Webserver started at http://127.27.186.65:38589/ using document root <none> and password file <none>
I20260811 16:46:23.877085 24678 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:23.877156 24678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:23.877311 24678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:23.878516 24678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "a9d9e10179424b9599b2bdb0b49932b3"
format_stamp: "Formatted at 2026-08-11 16:46:23 on dist-test-slave-gsp7"
server_key: "6b23d6ecd2ede614715ef4d098959398"
server_key_iv: "6666a1ce30a9acb67a7aea8c5c913249"
server_key_version: "encryptionkey@0"
I20260811 16:46:23.878909 24678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "a9d9e10179424b9599b2bdb0b49932b3"
format_stamp: "Formatted at 2026-08-11 16:46:23 on dist-test-slave-gsp7"
server_key: "6b23d6ecd2ede614715ef4d098959398"
server_key_iv: "6666a1ce30a9acb67a7aea8c5c913249"
server_key_version: "encryptionkey@0"
I20260811 16:46:23.880476 24678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:23.881279 24695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:23.881456 24678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:23.881633 24678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "a9d9e10179424b9599b2bdb0b49932b3"
format_stamp: "Formatted at 2026-08-11 16:46:23 on dist-test-slave-gsp7"
server_key: "6b23d6ecd2ede614715ef4d098959398"
server_key_iv: "6666a1ce30a9acb67a7aea8c5c913249"
server_key_version: "encryptionkey@0"
I20260811 16:46:23.881716 24678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:23.907008 24678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:23.909088 24678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:23.909268 24678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:23.909595 24678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:23.909938 24678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:23.909994 24678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:23.910053 24678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:23.910082 24678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:23.916172 24678 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:42973
I20260811 16:46:23.916222 24873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:42973 every 8 connection(s)
I20260811 16:46:23.916599 24678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:46:23.920171 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 24678
I20260811 16:46:23.920271 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:46:23.920512 28393 external_mini_cluster.cc:1428] Setting key 4109fcc6f8c7cc3e5b74defab2bfb9b2
Aug 11 16:46:23 dist-test-slave-gsp7 krb5kdc[24491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466783, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:23.927213 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:23.917388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:37735 (local address 127.27.186.126:42417)
0811 16:46:23.917526 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:23.917528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:23.917706 (+ 178us) server_negotiation.cc:407] Connection header received
0811 16:46:23.918277 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:23.918279 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:23.918296 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:23.918344 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:23.919371 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:23.919903 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:23.921237 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:23.921609 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:23.921691 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:23.924055 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:23.924057 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:23.924058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:23.924066 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:23.925601 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:23.926171 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:23.926172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:23.926172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:23.926224 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:23.926527 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:23.926528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:23.926529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:23.926632 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:23.926683 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:23.927069 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 16:46:23.927145 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 16:46:23.927584 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:23.917343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:42417 (local address 127.27.186.65:37735)
0811 16:46:23.917563 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:23.917618 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:23.918156 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:23.918464 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:23.918467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:23.919058 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:23.919262 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:23.919267 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:23.920033 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:23.920034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:23.921123 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:23.921126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:23.921698 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:23.921699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:23.921808 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:23.922385 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:23.922393 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:23.923952 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:23.925727 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:23.925736 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:23.925739 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:23.926090 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:23.926296 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:23.926297 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:23.926297 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:23.926456 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:23.926702 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:23.926710 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:23.926902 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 16:46:23.927051 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 16:46:23.927244 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":98,"threads_started":1}
I20260811 16:46:23.928213 24880 heartbeater.cc:347] Connected to a master server at 127.27.186.126:42417
I20260811 16:46:23.928337 24880 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:23.928551 24880 heartbeater.cc:511] Master 127.27.186.126:42417 requested a full tablet report, sending...
I20260811 16:46:23.929159 24573 ts_manager.cc:194] Registered new tserver with Master: a9d9e10179424b9599b2bdb0b49932b3 (127.27.186.65:42973)
I20260811 16:46:23.929855 24573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:37735
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:46:23.952661 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:42417
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:37005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:24.038854 24888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:24.039129 24888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:24.039172 24888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:24.040362 24888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:24.040436 24888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:24.040483 24888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:46:24.042058 24888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:42417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:24.042346 24888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:24.042610 24888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:24.048557 24898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:24.048632 24888 server_base.cc:1034] running on GCE node
W20260811 16:46:24.048547 24900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:24.048544 24897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:24.049060 24888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:24.049332 24888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:24.050504 24888 hybrid_clock.cc:648] HybridClock initialized: now 1786466784050497 us; error 40 us; skew 500 ppm
Aug 11 16:46:24 dist-test-slave-gsp7 krb5kdc[24491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466784, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:24.053151 24888 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:46:24.053741 24888 webserver.cc:460] Webserver started at http://127.27.186.66:40447/ using document root <none> and password file <none>
I20260811 16:46:24.054014 24888 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:24.054091 24888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:24.054248 24888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:24.055397 24888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "e08ff40f1930485999ffd3050abdf40b"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "9ab2f4469974a7005c47ded3573f8a35"
server_key_iv: "5342edc8a948e6b370a7860709d21b97"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.055796 24888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "e08ff40f1930485999ffd3050abdf40b"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "9ab2f4469974a7005c47ded3573f8a35"
server_key_iv: "5342edc8a948e6b370a7860709d21b97"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.057410 24888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:24.058374 24908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.058590 24888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:24.058694 24888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "e08ff40f1930485999ffd3050abdf40b"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "9ab2f4469974a7005c47ded3573f8a35"
server_key_iv: "5342edc8a948e6b370a7860709d21b97"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.058782 24888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:24.071714 24888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:24.074434 24888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:24.074642 24888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:24.074939 24888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:24.075286 24888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:24.075349 24888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.075393 24888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:24.075421 24888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.082569 24888 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:45167
I20260811 16:46:24.082617 25092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:45167 every 8 connection(s)
I20260811 16:46:24.082962 24888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:46:24.088979 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 24888
I20260811 16:46:24.089118 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:46:24.089361 28393 external_mini_cluster.cc:1428] Setting key b098de6cb35e8d2a766df4f97d15a01f
Aug 11 16:46:24 dist-test-slave-gsp7 krb5kdc[24491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466784, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:24.093122 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.083715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:37203 (local address 127.27.186.126:42417)
0811 16:46:24.083783 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.083787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.084031 (+ 244us) server_negotiation.cc:407] Connection header received
0811 16:46:24.084570 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.084571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.084581 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.084645 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:24.085806 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.086337 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.087403 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.087608 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.087671 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.090141 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:24.090143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:24.090143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:24.090153 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:24.091675 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:24.092117 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:24.092119 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:24.092119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:24.092183 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:24.092444 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:24.092445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:24.092445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:24.092567 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:24.092646 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.092931 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.093027 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:46:24.093325 25097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.083703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:42417 (local address 127.27.186.66:37203)
0811 16:46:24.083893 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.083939 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.084479 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.084737 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.084782 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.085411 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:24.085694 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.085701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.086425 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.086425 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.087306 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.087308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.087693 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.087694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.087798 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.088303 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:24.088311 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:24.090046 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:24.091782 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:24.091791 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:24.091794 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:24.092034 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:24.092253 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:24.092254 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:24.092255 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:24.092374 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:24.092635 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:24.092643 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:24.092793 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.092907 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.093084 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
I20260811 16:46:24.093851 25094 heartbeater.cc:347] Connected to a master server at 127.27.186.126:42417
I20260811 16:46:24.093955 25094 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:24.094156 25094 heartbeater.cc:511] Master 127.27.186.126:42417 requested a full tablet report, sending...
I20260811 16:46:24.094548 24573 ts_manager.cc:194] Registered new tserver with Master: e08ff40f1930485999ffd3050abdf40b (127.27.186.66:45167)
I20260811 16:46:24.094980 24573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:37203
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:46:24.120064 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:42417
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:37005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:24.207690 25105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:24.207903 25105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:24.207927 25105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:24.209030 25105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:24.209067 25105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:24.209095 25105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:46:24.210632 25105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:42417
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:24.210834 25105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:24.211040 25105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:24.216262 25116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:24.216413 25105 server_base.cc:1034] running on GCE node
W20260811 16:46:24.216279 25115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:24.216271 25119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:24.216857 25105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:24.217101 25105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:24.218245 25105 hybrid_clock.cc:648] HybridClock initialized: now 1786466784218231 us; error 30 us; skew 500 ppm
Aug 11 16:46:24 dist-test-slave-gsp7 krb5kdc[24491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466784, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:24.220696 25105 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:46:24.221202 25105 webserver.cc:460] Webserver started at http://127.27.186.67:44157/ using document root <none> and password file <none>
I20260811 16:46:24.221469 25105 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:24.221611 25105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:24.221750 25105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:24.222864 25105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "73521d2287c544418652fc637cc83177"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "94f445e6f71e3390eda096108a7a5cb5"
server_key_iv: "910552bed5976f0c2c3ef2a3cda0aa25"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.223266 25105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "73521d2287c544418652fc637cc83177"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "94f445e6f71e3390eda096108a7a5cb5"
server_key_iv: "910552bed5976f0c2c3ef2a3cda0aa25"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.224697 25105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:24.225580 25131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.225847 25105 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:24.225968 25105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "73521d2287c544418652fc637cc83177"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "94f445e6f71e3390eda096108a7a5cb5"
server_key_iv: "910552bed5976f0c2c3ef2a3cda0aa25"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.226068 25105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:24.238072 25105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:24.240162 25105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:24.240338 25105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:24.240597 25105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:24.240931 25105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:24.240988 25105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.241061 25105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:24.241093 25105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.247797 25105 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:43143
I20260811 16:46:24.247880 25327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:43143 every 8 connection(s)
I20260811 16:46:24.248245 25105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
Aug 11 16:46:24 dist-test-slave-gsp7 krb5kdc[24491](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466784, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:24.256394 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 25105
I20260811 16:46:24.256556 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:46:24.256749 28393 external_mini_cluster.cc:1428] Setting key bede6fccdd3419bac78abc3aa050769f
I20260811 16:46:24.258329 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.249024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:42487 (local address 127.27.186.126:42417)
0811 16:46:24.249112 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.249114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.249323 (+ 209us) server_negotiation.cc:407] Connection header received
0811 16:46:24.249891 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.249893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.249903 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.249967 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:24.250944 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.251542 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.252552 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.252752 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.252826 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.255195 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:24.255197 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:24.255198 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:24.255205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:24.256746 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:24.257247 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:24.257249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:24.257249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:24.257320 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:24.257719 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:24.257720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:24.257721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:24.257881 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:24.257935 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.258191 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.258263 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:46:24.258478 25334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.248991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:42417 (local address 127.27.186.67:42487)
0811 16:46:24.249197 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.249236 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.249801 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.250042 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.250045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.250622 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:24.250828 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.250833 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.251645 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.251646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.252449 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.252451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.252842 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.252843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.252942 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.253529 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:24.253541 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:24.255100 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:24.256845 (+ 1745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:24.256853 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:24.256856 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:24.257168 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:24.257430 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:24.257431 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:24.257431 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:24.257622 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:24.257937 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:24.257943 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:24.258066 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.258143 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.258268 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":122,"threads_started":1}
I20260811 16:46:24.258936 25329 heartbeater.cc:347] Connected to a master server at 127.27.186.126:42417
I20260811 16:46:24.259063 25329 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:24.259253 25329 heartbeater.cc:511] Master 127.27.186.126:42417 requested a full tablet report, sending...
I20260811 16:46:24.259639 24573 ts_manager.cc:194] Registered new tserver with Master: 73521d2287c544418652fc637cc83177 (127.27.186.67:43143)
I20260811 16:46:24.259982 24573 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:42487
I20260811 16:46:24.268873 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:46:24.276533 24671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.270444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34050 (local address 127.27.186.126:42417)
0811 16:46:24.270517 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.270519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.270665 (+ 146us) server_negotiation.cc:407] Connection header received
0811 16:46:24.270695 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.270696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.270707 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.270761 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:24.271313 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.271818 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.272577 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.272782 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.272846 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.274184 (+ 1338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:24.274186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:24.274186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:24.274193 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:24.275522 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:24.275844 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:24.275844 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:24.275845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:24.275897 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:24.276067 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:24.276068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:24.276068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:24.276229 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:24.276312 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.276398 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.276460 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:46:24.278443 24573 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34050:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:46:24.280186 24573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:46:24.287458 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.282946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56188 (local address 127.27.186.67:43143)
0811 16:46:24.283372 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.283378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.283390 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:46:24.283438 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.283440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.283457 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.283760 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:24.283837 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.284770 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.286313 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.287012 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.287088 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.287155 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.287321 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.287364 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":119,"threads_started":1}
I20260811 16:46:24.287458 25349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.282812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:43143 (local address 127.0.0.1:56188)
0811 16:46:24.282985 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.283026 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.283090 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.283587 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.283590 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.283593 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:24.283673 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.283676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.284882 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.284884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.286197 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.286201 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.287104 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.287105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.287187 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.287204 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.287289 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.287367 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":26,"thread_start_us":69,"threads_started":1}
I20260811 16:46:24.287467 25350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.282812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:42973 (local address 127.0.0.1:50546)
0811 16:46:24.282984 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.283030 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.283105 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.283603 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.283604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.283607 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:24.283696 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.283699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.285148 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.285150 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.286115 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.286118 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.287108 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.287109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.287199 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.287204 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.287283 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.287359 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":102,"threads_started":1}
I20260811 16:46:24.287777 25354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.283204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50546 (local address 127.27.186.65:42973)
0811 16:46:24.283390 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.283395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.283406 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:46:24.283449 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.283451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.283494 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.283788 (+ 294us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:24.283871 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.285021 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.286206 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.286991 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.287518 (+ 527us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.287599 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.287631 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.287686 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":113,"threads_started":1}
I20260811 16:46:24.288105 25352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.283071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:45167 (local address 127.0.0.1:60470)
0811 16:46:24.283646 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.283656 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.283709 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.283952 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.283953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.283955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:24.283992 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.283993 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.285280 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.285281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.286521 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.286524 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.287843 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.287844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.287911 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.287916 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.287987 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.288035 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":163,"thread_start_us":86,"threads_started":1}
I20260811 16:46:24.288405 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.283339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60470 (local address 127.27.186.66:45167)
0811 16:46:24.283560 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.283564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.283781 (+ 217us) server_negotiation.cc:407] Connection header received
0811 16:46:24.283832 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.283835 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.283851 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.283933 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:24.284062 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.285165 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.286628 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.287217 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.287300 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.287359 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.288257 (+ 898us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.288307 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":94,"threads_started":1}
I20260811 16:46:24.288589 24772 tablet_service.cc:1467] Processing CreateTablet for tablet 1e353b1e1bf047e887e2092dfc764dff (DEFAULT_TABLE table=test-table [id=d49e9cd2eebb446492f03c88ccca012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:24.288729 25210 tablet_service.cc:1467] Processing CreateTablet for tablet 1e353b1e1bf047e887e2092dfc764dff (DEFAULT_TABLE table=test-table [id=d49e9cd2eebb446492f03c88ccca012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:24.289007 24772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e353b1e1bf047e887e2092dfc764dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:24.289031 25210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e353b1e1bf047e887e2092dfc764dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:24.289122 24989 tablet_service.cc:1467] Processing CreateTablet for tablet 1e353b1e1bf047e887e2092dfc764dff (DEFAULT_TABLE table=test-table [id=d49e9cd2eebb446492f03c88ccca012f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:24.289525 24989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e353b1e1bf047e887e2092dfc764dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:24.292339 25357 tablet_bootstrap.cc:492] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Bootstrap starting.
I20260811 16:46:24.292709 25359 tablet_bootstrap.cc:492] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3: Bootstrap starting.
I20260811 16:46:24.293190 25357 tablet_bootstrap.cc:654] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:24.293407 25359 tablet_bootstrap.cc:654] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:24.293922 25357 log.cc:824] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:24.294078 25359 log.cc:824] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:24.294405 25358 tablet_bootstrap.cc:492] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: Bootstrap starting.
I20260811 16:46:24.294873 25359 tablet_bootstrap.cc:492] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3: No bootstrap required, opened a new log
I20260811 16:46:24.294920 25357 tablet_bootstrap.cc:492] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: No bootstrap required, opened a new log
I20260811 16:46:24.294960 25359 ts_tablet_manager.cc:1397] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:46:24.294979 25357 ts_tablet_manager.cc:1397] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:46:24.295151 25358 tablet_bootstrap.cc:654] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:24.295743 25358 log.cc:824] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:24.296545 25358 tablet_bootstrap.cc:492] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: No bootstrap required, opened a new log
I20260811 16:46:24.296620 25358 ts_tablet_manager.cc:1397] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:46:24.297062 25357 raft_consensus.cc:348] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.297098 25359 raft_consensus.cc:348] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.297235 25357 raft_consensus.cc:374] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:24.297281 25357 raft_consensus.cc:729] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e08ff40f1930485999ffd3050abdf40b, State: Initialized, Role: FOLLOWER
I20260811 16:46:24.297282 25359 raft_consensus.cc:374] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:24.297317 25359 raft_consensus.cc:729] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d9e10179424b9599b2bdb0b49932b3, State: Initialized, Role: FOLLOWER
I20260811 16:46:24.297464 25357 consensus_queue.cc:260] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.297526 25359 consensus_queue.cc:260] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.297842 25359 ts_tablet_manager.cc:1428] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:46:24.297843 25357 ts_tablet_manager.cc:1428] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260811 16:46:24.297887 25094 heartbeater.cc:503] Master 127.27.186.126:42417 was elected leader, sending a full tablet report...
I20260811 16:46:24.297998 24880 heartbeater.cc:503] Master 127.27.186.126:42417 was elected leader, sending a full tablet report...
I20260811 16:46:24.299296 25358 raft_consensus.cc:348] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.299466 25358 raft_consensus.cc:374] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:24.299492 25358 raft_consensus.cc:729] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73521d2287c544418652fc637cc83177, State: Initialized, Role: FOLLOWER
I20260811 16:46:24.299567 25358 consensus_queue.cc:260] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.299763 25358 ts_tablet_manager.cc:1428] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:46:24.299822 25329 heartbeater.cc:503] Master 127.27.186.126:42417 was elected leader, sending a full tablet report...
W20260811 16:46:24.333644 25095 tablet.cc:2369] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:46:24.378870 25366 raft_consensus.cc:482] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:24.379045 25366 raft_consensus.cc:504] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.379528 25366 leader_election.cc:288] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73521d2287c544418652fc637cc83177 (127.27.186.67:43143), e08ff40f1930485999ffd3050abdf40b (127.27.186.66:45167)
I20260811 16:46:24.382746 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.379802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:48103 (local address 127.27.186.67:43143)
0811 16:46:24.379864 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.379866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.379880 (+ 14us) server_negotiation.cc:407] Connection header received
0811 16:46:24.379951 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.379952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.379961 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.380012 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:24.380198 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.380742 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.381858 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.382405 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.382462 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.382470 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.382661 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.382690 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:46:24.382763 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.379748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:43143 (local address 127.27.186.65:48103)
0811 16:46:24.379812 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.379825 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.379875 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.380044 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.380045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.380047 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:24.380121 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.380122 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.380827 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.380828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.381773 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.381776 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.382498 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.382499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.382583 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.382587 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.382647 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.382688 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 16:46:24.383152 25368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.379749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:45167 (local address 127.27.186.65:55709)
0811 16:46:24.380112 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.380121 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.380199 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.380345 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.380346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.380348 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:24.380422 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.380424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.381224 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.381226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.382191 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.382194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.382930 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.382931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.383012 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.383015 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.383074 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.383101 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":91,"thread_start_us":174,"threads_started":1}
I20260811 16:46:24.383252 25243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e353b1e1bf047e887e2092dfc764dff" candidate_uuid: "a9d9e10179424b9599b2bdb0b49932b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73521d2287c544418652fc637cc83177" is_pre_election: true
I20260811 16:46:24.383450 25243 raft_consensus.cc:2454] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d9e10179424b9599b2bdb0b49932b3 in term 0.
I20260811 16:46:24.383731 25356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.379831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:55709 (local address 127.27.186.66:45167)
0811 16:46:24.379892 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.379894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.380211 (+ 317us) server_negotiation.cc:407] Connection header received
0811 16:46:24.380252 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.380253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.380261 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.380326 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:24.380503 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.381107 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.382281 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.382820 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.382887 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.382896 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.383616 (+ 720us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.383663 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:46:24.383718 24696 leader_election.cc:302] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73521d2287c544418652fc637cc83177, a9d9e10179424b9599b2bdb0b49932b3; no voters:
I20260811 16:46:24.383843 25366 raft_consensus.cc:2781] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:46:24.383903 25366 raft_consensus.cc:482] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:46:24.383934 25366 raft_consensus.cc:3037] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:24.384050 25023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e353b1e1bf047e887e2092dfc764dff" candidate_uuid: "a9d9e10179424b9599b2bdb0b49932b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e08ff40f1930485999ffd3050abdf40b" is_pre_election: true
I20260811 16:46:24.384210 25023 raft_consensus.cc:2454] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d9e10179424b9599b2bdb0b49932b3 in term 0.
I20260811 16:46:24.384940 25366 raft_consensus.cc:504] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.385110 25366 leader_election.cc:288] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [CANDIDATE]: Term 1 election: Requested vote from peers 73521d2287c544418652fc637cc83177 (127.27.186.67:43143), e08ff40f1930485999ffd3050abdf40b (127.27.186.66:45167)
I20260811 16:46:24.385238 25243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e353b1e1bf047e887e2092dfc764dff" candidate_uuid: "a9d9e10179424b9599b2bdb0b49932b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73521d2287c544418652fc637cc83177"
I20260811 16:46:24.385314 25023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e353b1e1bf047e887e2092dfc764dff" candidate_uuid: "a9d9e10179424b9599b2bdb0b49932b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e08ff40f1930485999ffd3050abdf40b"
I20260811 16:46:24.385344 25243 raft_consensus.cc:3037] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:24.385418 25023 raft_consensus.cc:3037] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:24.386212 25023 raft_consensus.cc:2454] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d9e10179424b9599b2bdb0b49932b3 in term 1.
I20260811 16:46:24.386232 25243 raft_consensus.cc:2454] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d9e10179424b9599b2bdb0b49932b3 in term 1.
I20260811 16:46:24.386432 24700 leader_election.cc:302] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d9e10179424b9599b2bdb0b49932b3, e08ff40f1930485999ffd3050abdf40b; no voters:
I20260811 16:46:24.386561 25366 raft_consensus.cc:2781] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:24.386711 25366 raft_consensus.cc:686] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [term 1 LEADER]: Becoming Leader. State: Replica: a9d9e10179424b9599b2bdb0b49932b3, State: Running, Role: LEADER
I20260811 16:46:24.386821 25366 consensus_queue.cc:237] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } }
I20260811 16:46:24.387696 24573 catalog_manager.cc:5495] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d9e10179424b9599b2bdb0b49932b3 (127.27.186.65). New cstate: current_term: 1 leader_uuid: "a9d9e10179424b9599b2bdb0b49932b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d9e10179424b9599b2bdb0b49932b3" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 42973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 } health_report { overall_health: UNKNOWN } } }
I20260811 16:46:24.405395 25354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.402805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50560 (local address 127.27.186.65:42973)
0811 16:46:24.402872 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.402874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.402907 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:46:24.403000 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.403001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.403021 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.403116 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:46:24.403266 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.403758 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.404537 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.404748 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.404829 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.404996 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:46:24.405112 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:46:24.405212 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.405237 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.405256 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 16:46:24.407527 25023 raft_consensus.cc:1261] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 1 FOLLOWER]: Refusing update from remote peer a9d9e10179424b9599b2bdb0b49932b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:24.407534 25243 raft_consensus.cc:1261] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 1 FOLLOWER]: Refusing update from remote peer a9d9e10179424b9599b2bdb0b49932b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:24.407984 25369 consensus_queue.cc:1035] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73521d2287c544418652fc637cc83177" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:24.408129 25366 consensus_queue.cc:1035] T 1e353b1e1bf047e887e2092dfc764dff P a9d9e10179424b9599b2bdb0b49932b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e08ff40f1930485999ffd3050abdf40b" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 45167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:24.411665 25379 mvcc.cc:205] Tried to move back new op lower bound from 7317367948929802240 to 7317367948848906240. Current Snapshot: MvccSnapshot[applied={T|T < 7317367948929802240 or (T in {7317367948929802240})}]
I20260811 16:46:24.413129 24573 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:24.413233 24573 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:24.414058 24573 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c90a9ce4bb774422b49eb7a997529da7: Sending DeleteTablet for 3 replicas of tablet 1e353b1e1bf047e887e2092dfc764dff
I20260811 16:46:24.414399 24772 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e353b1e1bf047e887e2092dfc764dff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:24 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:50546
I20260811 16:46:24.414430 25210 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e353b1e1bf047e887e2092dfc764dff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:24 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:56188
I20260811 16:46:24.414553 24989 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e353b1e1bf047e887e2092dfc764dff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:24 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:60470
I20260811 16:46:24.414675 25395 tablet_replica.cc:330] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: stopping tablet replica
I20260811 16:46:24.414776 25395 raft_consensus.cc:2229] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:24.414794 25396 tablet_replica.cc:330] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: stopping tablet replica
I20260811 16:46:24.414881 25395 raft_consensus.cc:2258] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:24.414888 25396 raft_consensus.cc:2229] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:24.415077 25396 raft_consensus.cc:2258] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:24.415350 25395 ts_tablet_manager.cc:1905] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:24.415400 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 24678
I20260811 16:46:24.415529 25396 ts_tablet_manager.cc:1905] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:24.417089 25395 ts_tablet_manager.cc:1918] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:24.417171 25395 log.cc:1196] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/1e353b1e1bf047e887e2092dfc764dff
I20260811 16:46:24.417380 25396 ts_tablet_manager.cc:1918] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:24.417439 25396 log.cc:1196] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/1e353b1e1bf047e887e2092dfc764dff
I20260811 16:46:24.417524 25395 ts_tablet_manager.cc:1939] T 1e353b1e1bf047e887e2092dfc764dff P 73521d2287c544418652fc637cc83177: Deleting consensus metadata
I20260811 16:46:24.417717 25396 ts_tablet_manager.cc:1939] T 1e353b1e1bf047e887e2092dfc764dff P e08ff40f1930485999ffd3050abdf40b: Deleting consensus metadata
I20260811 16:46:24.418027 24548 catalog_manager.cc:4841] TS 73521d2287c544418652fc637cc83177 (127.27.186.67:43143): tablet 1e353b1e1bf047e887e2092dfc764dff (table test-table [id=d49e9cd2eebb446492f03c88ccca012f]) successfully deleted
I20260811 16:46:24.422205 24549 catalog_manager.cc:4841] TS e08ff40f1930485999ffd3050abdf40b (127.27.186.66:45167): tablet 1e353b1e1bf047e887e2092dfc764dff (table test-table [id=d49e9cd2eebb446492f03c88ccca012f]) successfully deleted
W20260811 16:46:24.427857 24550 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:42973 (error 108)
I20260811 16:46:24.428231 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 24888
I20260811 16:46:24.433704 25352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.428405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:42973 (local address 127.0.0.1:50576)
0811 16:46:24.433590 (+ 5185us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.433658 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:42973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5151}
W20260811 16:46:24.442548 24550 catalog_manager.cc:4584] TS a9d9e10179424b9599b2bdb0b49932b3 (127.27.186.65:42973): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1e353b1e1bf047e887e2092dfc764dff: Network error: Client connection negotiation failed: client connection to 127.27.186.65:42973: connect: Connection refused (error 111)
I20260811 16:46:24.448638 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 25105
I20260811 16:46:24.464949 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 24515
2026-08-11T16:46:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2315 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T16:46:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:24Z Disabled control of system clock
I20260811 16:46:24.503952 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41377
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:41377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:24.586333 25407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:24.586570 25407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:24.586591 25407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:24.587787 25407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:24.587836 25407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:24.587848 25407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:24.587862 25407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:24.587904 25407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:24.589278 25407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:41377
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:24.589599 25407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:24.589941 25407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:24.595098 25422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:24.595126 25419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:24.595104 25417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:24.595446 25407 server_base.cc:1034] running on GCE node
I20260811 16:46:24.595767 25407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:24.596131 25407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:24.597280 25407 hybrid_clock.cc:648] HybridClock initialized: now 1786466784597246 us; error 51 us; skew 500 ppm
I20260811 16:46:24.598662 25407 webserver.cc:460] Webserver started at http://127.27.186.126:35233/ using document root <none> and password file <none>
I20260811 16:46:24.598933 25407 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:24.598984 25407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:24.599081 25407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:24.600198 25407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "6132dc3eda8940cbbc9fd6ac020d7552"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "7d8777bd86f08ca0d4efc23cec521200"
server_key_iv: "a05684061383944b209ad1cbc9bce6a4"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.600579 25407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "6132dc3eda8940cbbc9fd6ac020d7552"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "7d8777bd86f08ca0d4efc23cec521200"
server_key_iv: "a05684061383944b209ad1cbc9bce6a4"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.602074 25407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 16:46:24.602865 25432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.603035 25407 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:24.603147 25407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "6132dc3eda8940cbbc9fd6ac020d7552"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "7d8777bd86f08ca0d4efc23cec521200"
server_key_iv: "a05684061383944b209ad1cbc9bce6a4"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.603225 25407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:24.617398 25407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:24.617805 25407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:24.617990 25407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:24.622262 25407 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:41377
I20260811 16:46:24.622306 25506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:41377 every 8 connection(s)
I20260811 16:46:24.622674 25407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:24.623682 25507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:24.626210 25507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552: Bootstrap starting.
I20260811 16:46:24.626830 25507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:24.627159 25507 log.cc:824] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:24.627893 25507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552: No bootstrap required, opened a new log
I20260811 16:46:24.628962 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 25407
I20260811 16:46:24.629082 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:24.629297 28393 external_mini_cluster.cc:1428] Setting key 57ad5d97acdaa68afec5e816c678382a
I20260811 16:46:24.630057 25507 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6132dc3eda8940cbbc9fd6ac020d7552" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41377 } }
I20260811 16:46:24.630268 25507 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:24.630311 25507 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6132dc3eda8940cbbc9fd6ac020d7552, State: Initialized, Role: FOLLOWER
I20260811 16:46:24.630441 25507 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6132dc3eda8940cbbc9fd6ac020d7552" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41377 } }
I20260811 16:46:24.630532 25507 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:24.630574 25507 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:24.630630 25507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:24.631465 25507 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6132dc3eda8940cbbc9fd6ac020d7552" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41377 } }
I20260811 16:46:24.631603 25507 leader_election.cc:302] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6132dc3eda8940cbbc9fd6ac020d7552; no voters:
I20260811 16:46:24.631765 25507 leader_election.cc:288] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:24.631847 25512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:24.632025 25507 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:24.632050 25512 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [term 1 LEADER]: Becoming Leader. State: Replica: 6132dc3eda8940cbbc9fd6ac020d7552, State: Running, Role: LEADER
I20260811 16:46:24.632181 25512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6132dc3eda8940cbbc9fd6ac020d7552" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41377 } }
I20260811 16:46:24.632604 25512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6132dc3eda8940cbbc9fd6ac020d7552. Latest consensus state: current_term: 1 leader_uuid: "6132dc3eda8940cbbc9fd6ac020d7552" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6132dc3eda8940cbbc9fd6ac020d7552" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41377 } } }
I20260811 16:46:24.632614 25513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6132dc3eda8940cbbc9fd6ac020d7552" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6132dc3eda8940cbbc9fd6ac020d7552" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41377 } } }
I20260811 16:46:24.632709 25513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:24.632884 25512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:24.632906 25526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:24.633538 25526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:24.635403 25526 catalog_manager.cc:1347] Generated new cluster ID: 19c3f6d2aab44b1faf0f01b272086617
I20260811 16:46:24.635454 25526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:24.636250 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.629966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60368 (local address 127.27.186.126:41377)
0811 16:46:24.630250 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.630260 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.630297 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:46:24.630417 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.630424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.630508 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.630668 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:24.630873 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.632710 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.633977 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.634609 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.634729 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.635558 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:24.635562 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:24.635563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:24.635749 (+ 186us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:24.635782 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:24.635793 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:24.635876 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.635952 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.636034 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":135,"threads_started":1}
I20260811 16:46:24.639444 25526 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:24.640131 25526 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:24.646629 25526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552: Generated new TSK 0
I20260811 16:46:24.646917 25526 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:24.655800 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41377
--builtin_ntp_servers=127.27.186.84:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:24.750742 25545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:24.750998 25545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:24.751037 25545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:24.752285 25545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:24.752344 25545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:24.752388 25545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:46:24.753844 25545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:24.754113 25545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:24.754434 25545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:24.759728 25561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:24.759774 25559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:24.759811 25558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:24.760288 25545 server_base.cc:1034] running on GCE node
I20260811 16:46:24.760519 25545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:24.760802 25545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:24.761981 25545 hybrid_clock.cc:648] HybridClock initialized: now 1786466784761963 us; error 38 us; skew 500 ppm
I20260811 16:46:24.763427 25545 webserver.cc:460] Webserver started at http://127.27.186.65:43045/ using document root <none> and password file <none>
I20260811 16:46:24.763700 25545 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:24.763772 25545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:24.763935 25545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:24.765053 25545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "36a606a4f9524709b9b71089e2372f9d"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "453da21d40ea325205bc29d95f7c2ebb"
server_key_iv: "afd5fb38656a386997fd5e663cef54c1"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.765439 25545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "36a606a4f9524709b9b71089e2372f9d"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "453da21d40ea325205bc29d95f7c2ebb"
server_key_iv: "afd5fb38656a386997fd5e663cef54c1"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.766857 25545 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:24.767671 25570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.767870 25545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:24.767980 25545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "36a606a4f9524709b9b71089e2372f9d"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "453da21d40ea325205bc29d95f7c2ebb"
server_key_iv: "afd5fb38656a386997fd5e663cef54c1"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.768059 25545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:24.775516 25545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:24.775812 25545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:24.775972 25545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:24.776235 25545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:24.776584 25545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:24.776618 25545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.776640 25545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:24.776672 25545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.784185 25545 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:44901
I20260811 16:46:24.784327 25757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:44901 every 8 connection(s)
I20260811 16:46:24.784660 25545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:46:24.790243 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.785567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:44717 (local address 127.27.186.126:41377)
0811 16:46:24.785637 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.785638 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.785850 (+ 212us) server_negotiation.cc:407] Connection header received
0811 16:46:24.786374 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.786376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.786391 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.786460 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:24.787141 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.787685 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.788711 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.788920 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.788979 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.789969 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:24.789970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:24.789970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:24.789975 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:24.789990 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:24.789995 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:24.790060 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.790144 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.790177 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:46:24.790484 25764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.785535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41377 (local address 127.27.186.65:44717)
0811 16:46:24.785719 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.785764 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.786279 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.786516 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.786519 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.786528 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:24.787048 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.787052 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.787819 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.787820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.788619 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.788622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.789033 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.789034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.789168 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.789817 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:24.789817 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:24.789847 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:24.789871 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:24.790072 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:24.790076 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:24.790079 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.790134 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.790219 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
I20260811 16:46:24.791085 25758 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41377
I20260811 16:46:24.791222 25758 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:24.791441 25758 heartbeater.cc:511] Master 127.27.186.126:41377 requested a full tablet report, sending...
I20260811 16:46:24.791950 25454 ts_manager.cc:194] Registered new tserver with Master: 36a606a4f9524709b9b71089e2372f9d (127.27.186.65:44901)
I20260811 16:46:24.792582 25454 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.65:44717
I20260811 16:46:24.792814 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 25545
I20260811 16:46:24.792937 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:46:24.793170 28393 external_mini_cluster.cc:1428] Setting key 6f1788376ac018782f9603f375560491
I20260811 16:46:24.794253 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41377
--builtin_ntp_servers=127.27.186.84:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:24.880530 25766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:24.880751 25766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:24.880774 25766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:24.882041 25766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:24.882090 25766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:24.882117 25766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:46:24.883526 25766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:24.883836 25766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:24.884193 25766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:24.889703 25773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:24.889734 25776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:24.889742 25772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:24.889931 25766 server_base.cc:1034] running on GCE node
I20260811 16:46:24.890157 25766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:24.890413 25766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:24.891577 25766 hybrid_clock.cc:648] HybridClock initialized: now 1786466784891563 us; error 30 us; skew 500 ppm
I20260811 16:46:24.892966 25766 webserver.cc:460] Webserver started at http://127.27.186.66:42589/ using document root <none> and password file <none>
I20260811 16:46:24.893257 25766 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:24.893333 25766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:24.893530 25766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:24.894665 25766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "737975e227e24ff59c03101fcb23f82a"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "81353bae4505640b5f316c20b010aaaf"
server_key_iv: "0c91e13d5f8cc8d63366cba980aacfb7"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.895076 25766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "737975e227e24ff59c03101fcb23f82a"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "81353bae4505640b5f316c20b010aaaf"
server_key_iv: "0c91e13d5f8cc8d63366cba980aacfb7"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.896437 25766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:24.897234 25782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.897436 25766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:24.897570 25766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "737975e227e24ff59c03101fcb23f82a"
format_stamp: "Formatted at 2026-08-11 16:46:24 on dist-test-slave-gsp7"
server_key: "81353bae4505640b5f316c20b010aaaf"
server_key_iv: "0c91e13d5f8cc8d63366cba980aacfb7"
server_key_version: "encryptionkey@0"
I20260811 16:46:24.897652 25766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:24.917349 25766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:24.917753 25766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:24.917919 25766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:24.918195 25766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:24.918560 25766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:24.918615 25766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.918658 25766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:24.918686 25766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:24.924790 25766 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:42617
I20260811 16:46:24.924908 25963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:42617 every 8 connection(s)
I20260811 16:46:24.925230 25766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:46:24.930763 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.926092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:40231 (local address 127.27.186.126:41377)
0811 16:46:24.926208 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:24.926211 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:24.926390 (+ 179us) server_negotiation.cc:407] Connection header received
0811 16:46:24.926927 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:24.926928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:24.926952 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:24.927017 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:24.927708 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.928246 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.929284 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.929545 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.929622 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.930432 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:24.930433 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:24.930434 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:24.930439 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:24.930455 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:24.930460 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:24.930534 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:24.930648 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 16:46:24.930680 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 16:46:24.930979 25969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:24.926061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41377 (local address 127.27.186.66:40231)
0811 16:46:24.926252 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:24.926294 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:24.926806 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:24.927078 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:24.927082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:24.927091 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:24.927622 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.927626 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.928362 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.928363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.929170 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:24.929173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:24.929633 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:24.929634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:24.929776 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:24.930288 (+ 512us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:24.930289 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:24.930316 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:24.930338 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:24.930536 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:24.930543 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:24.930547 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:46:24.930640 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 16:46:24.930745 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260811 16:46:24.931484 25964 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41377
I20260811 16:46:24.931572 25964 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:24.931721 25964 heartbeater.cc:511] Master 127.27.186.126:41377 requested a full tablet report, sending...
I20260811 16:46:24.932060 25454 ts_manager.cc:194] Registered new tserver with Master: 737975e227e24ff59c03101fcb23f82a (127.27.186.66:42617)
I20260811 16:46:24.932479 25454 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.66:40231
I20260811 16:46:24.933689 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 25766
I20260811 16:46:24.933800 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:46:24.934000 28393 external_mini_cluster.cc:1428] Setting key ab1f11846f2f4e21751b460a9a3a8085
I20260811 16:46:24.934888 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41377
--builtin_ntp_servers=127.27.186.84:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:25.021589 25970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:25.021800 25970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:25.021824 25970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:25.023037 25970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:25.023084 25970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:25.023111 25970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:46:25.024539 25970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:25.024799 25970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:25.025161 25970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:25.030820 25986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:25.030825 25976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:25.030827 25977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:25.031006 25970 server_base.cc:1034] running on GCE node
I20260811 16:46:25.031380 25970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:25.031677 25970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:25.032826 25970 hybrid_clock.cc:648] HybridClock initialized: now 1786466785032782 us; error 64 us; skew 500 ppm
I20260811 16:46:25.034298 25970 webserver.cc:460] Webserver started at http://127.27.186.67:33483/ using document root <none> and password file <none>
I20260811 16:46:25.034590 25970 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:25.034641 25970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:25.034821 25970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:25.036069 25970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88"
format_stamp: "Formatted at 2026-08-11 16:46:25 on dist-test-slave-gsp7"
server_key: "aba872703b956d682275e80e326d091b"
server_key_iv: "52d6f82b279cf49931e69f2ea388c3aa"
server_key_version: "encryptionkey@0"
I20260811 16:46:25.036458 25970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88"
format_stamp: "Formatted at 2026-08-11 16:46:25 on dist-test-slave-gsp7"
server_key: "aba872703b956d682275e80e326d091b"
server_key_iv: "52d6f82b279cf49931e69f2ea388c3aa"
server_key_version: "encryptionkey@0"
I20260811 16:46:25.037946 25970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260811 16:46:25.038908 25998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:25.039096 25970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:25.039216 25970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88"
format_stamp: "Formatted at 2026-08-11 16:46:25 on dist-test-slave-gsp7"
server_key: "aba872703b956d682275e80e326d091b"
server_key_iv: "52d6f82b279cf49931e69f2ea388c3aa"
server_key_version: "encryptionkey@0"
I20260811 16:46:25.039301 25970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:25.070605 25970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:25.070963 25970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:25.071166 25970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:25.071462 25970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:25.071828 25970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:25.071887 25970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:25.071924 25970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:25.071974 25970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:25.078192 25970 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:43225
I20260811 16:46:25.078243 26174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:43225 every 8 connection(s)
I20260811 16:46:25.078595 25970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:46:25.081362 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 25970
I20260811 16:46:25.081488 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:46:25.081738 28393 external_mini_cluster.cc:1428] Setting key 8182585a11bf4742085fc22418472331
I20260811 16:46:25.084410 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.079386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:35369 (local address 127.27.186.126:41377)
0811 16:46:25.079472 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:25.079475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:25.079762 (+ 287us) server_negotiation.cc:407] Connection header received
0811 16:46:25.080253 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:25.080254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:25.080265 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:25.080322 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:25.081004 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.081677 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.083061 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.083253 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.083310 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.084195 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:25.084196 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:25.084196 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:25.084200 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:25.084211 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:25.084214 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:25.084253 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:25.084318 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 16:46:25.084349 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:46:25.084614 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.079381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41377 (local address 127.27.186.67:35369)
0811 16:46:25.079613 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:25.079651 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:25.080161 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:25.080393 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:25.080397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:25.080405 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:25.080920 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.080923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.081791 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.081792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.082979 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.082983 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.083331 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.083331 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.083442 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.084064 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:25.084064 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:25.084095 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:25.084119 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:25.084255 (+ 136us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:25.084257 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:25.084260 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:25.084307 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 16:46:25.084389 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":118,"threads_started":1}
I20260811 16:46:25.085140 26175 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41377
I20260811 16:46:25.085224 26175 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:25.085378 26175 heartbeater.cc:511] Master 127.27.186.126:41377 requested a full tablet report, sending...
I20260811 16:46:25.085820 25454 ts_manager.cc:194] Registered new tserver with Master: 6d11a3b6b21a40e5ba6d15cb1e9d7e88 (127.27.186.67:43225)
I20260811 16:46:25.086203 25454 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.67:35369
I20260811 16:46:25.093662 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:46:25.098272 25511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.095233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60382 (local address 127.27.186.126:41377)
0811 16:46:25.095302 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:25.095305 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:25.095374 (+ 69us) server_negotiation.cc:407] Connection header received
0811 16:46:25.095439 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:25.095440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:25.095450 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:25.095503 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:25.095671 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.096161 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.096964 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.097145 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.097196 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.098055 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:25.098056 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:25.098056 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:25.098060 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:25.098072 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:25.098076 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:25.098119 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:25.098184 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 16:46:25.098206 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:46:25.099761 25454 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60382:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:46:25.101387 25454 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:46:25.108326 26194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.103897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40856 (local address 127.27.186.66:42617)
0811 16:46:25.104183 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:25.104188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:25.104201 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:46:25.104347 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:25.104351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:25.104368 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:25.104440 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:25.104621 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.105863 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.107352 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.107871 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.107977 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.108089 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:25.108173 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:46:25.108216 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":148,"threads_started":1}
I20260811 16:46:25.108345 26195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.103767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:42617 (local address 127.0.0.1:40856)
0811 16:46:25.104120 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:25.104132 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:25.104201 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:25.104458 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:25.104461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:25.104462 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:25.104532 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.104535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.105984 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.105985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.107249 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.107252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.107977 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.107978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.108061 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.108075 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:46:25.108157 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 16:46:25.108222 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":50,"thread_start_us":61,"threads_started":1}
I20260811 16:46:25.108349 26193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.103767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:43225 (local address 127.0.0.1:33246)
0811 16:46:25.103925 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:25.103974 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:25.104264 (+ 290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:25.104852 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:25.104853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:25.104856 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:25.104892 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.104893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.105822 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.105823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.107049 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.107052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.108086 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.108088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.108152 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.108156 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:46:25.108187 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 16:46:25.108233 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":55,"thread_start_us":69,"threads_started":1}
I20260811 16:46:25.108996 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.104095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47716 (local address 127.27.186.65:44901)
0811 16:46:25.104395 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:25.104399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:25.104408 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:46:25.104451 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:25.104453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:25.104470 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:25.104543 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:25.104741 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.105878 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.107337 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.108067 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.108130 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.108225 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:25.108871 (+ 646us) server_negotiation.cc:299] Negotiation successful
0811 16:46:25.108915 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":91,"threads_started":1}
I20260811 16:46:25.109000 26197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.104162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33246 (local address 127.27.186.67:43225)
0811 16:46:25.104681 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:25.104687 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:25.104696 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:46:25.104736 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:25.104738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:25.104753 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:25.104856 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:25.104950 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.105752 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.107142 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.107972 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.108548 (+ 576us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.108682 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:25.108777 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 16:46:25.108897 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":111,"threads_started":1}
I20260811 16:46:25.109186 25861 tablet_service.cc:1467] Processing CreateTablet for tablet 097048d92e844c9b83cb94f9a5b8542b (DEFAULT_TABLE table=test-table [id=df351457826c41ab9d8a56dd172e37d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:25.109440 26191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.103976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:44901 (local address 127.0.0.1:47716)
0811 16:46:25.104256 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:25.104267 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:25.104309 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:25.104549 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:25.104550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:25.104552 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:25.104675 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.104677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.106008 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.106009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.107256 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.107258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.108259 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.108259 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.108318 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.108323 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:46:25.108372 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 16:46:25.109354 (+ 982us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":48,"thread_start_us":103,"threads_started":1}
I20260811 16:46:25.109668 25861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 097048d92e844c9b83cb94f9a5b8542b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:25.110143 25644 tablet_service.cc:1467] Processing CreateTablet for tablet 097048d92e844c9b83cb94f9a5b8542b (DEFAULT_TABLE table=test-table [id=df351457826c41ab9d8a56dd172e37d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:25.110486 25644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 097048d92e844c9b83cb94f9a5b8542b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:25.112753 26198 tablet_bootstrap.cc:492] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Bootstrap starting.
I20260811 16:46:25.113226 26200 tablet_bootstrap.cc:492] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d: Bootstrap starting.
I20260811 16:46:25.113224 26072 tablet_service.cc:1467] Processing CreateTablet for tablet 097048d92e844c9b83cb94f9a5b8542b (DEFAULT_TABLE table=test-table [id=df351457826c41ab9d8a56dd172e37d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:25.113524 26198 tablet_bootstrap.cc:654] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:25.113613 26072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 097048d92e844c9b83cb94f9a5b8542b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:25.113896 26198 log.cc:824] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:25.113940 26200 tablet_bootstrap.cc:654] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:25.114300 26200 log.cc:824] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:25.114719 26198 tablet_bootstrap.cc:492] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: No bootstrap required, opened a new log
I20260811 16:46:25.114779 26198 ts_tablet_manager.cc:1397] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:46:25.115531 26200 tablet_bootstrap.cc:492] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d: No bootstrap required, opened a new log
I20260811 16:46:25.115615 26200 ts_tablet_manager.cc:1397] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:46:25.116955 26204 tablet_bootstrap.cc:492] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: Bootstrap starting.
I20260811 16:46:25.117697 26204 tablet_bootstrap.cc:654] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:25.117714 26198 raft_consensus.cc:348] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.117905 26198 raft_consensus.cc:374] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:25.117956 26198 raft_consensus.cc:729] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737975e227e24ff59c03101fcb23f82a, State: Initialized, Role: FOLLOWER
I20260811 16:46:25.118088 26204 log.cc:824] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:25.118117 26198 consensus_queue.cc:260] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.118394 26198 ts_tablet_manager.cc:1428] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 16:46:25.118350 26200 raft_consensus.cc:348] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.118517 26200 raft_consensus.cc:374] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:25.118562 26200 raft_consensus.cc:729] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a606a4f9524709b9b71089e2372f9d, State: Initialized, Role: FOLLOWER
I20260811 16:46:25.118609 25964 heartbeater.cc:503] Master 127.27.186.126:41377 was elected leader, sending a full tablet report...
I20260811 16:46:25.118714 26200 consensus_queue.cc:260] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.119036 26200 ts_tablet_manager.cc:1428] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:46:25.119093 25758 heartbeater.cc:503] Master 127.27.186.126:41377 was elected leader, sending a full tablet report...
I20260811 16:46:25.120206 26204 tablet_bootstrap.cc:492] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: No bootstrap required, opened a new log
I20260811 16:46:25.120286 26204 ts_tablet_manager.cc:1397] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:46:25.122244 26204 raft_consensus.cc:348] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.122368 26204 raft_consensus.cc:374] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:25.122390 26204 raft_consensus.cc:729] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d11a3b6b21a40e5ba6d15cb1e9d7e88, State: Initialized, Role: FOLLOWER
I20260811 16:46:25.122537 26204 consensus_queue.cc:260] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.122788 26204 ts_tablet_manager.cc:1428] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:46:25.122861 26175 heartbeater.cc:503] Master 127.27.186.126:41377 was elected leader, sending a full tablet report...
W20260811 16:46:25.175937 25966 tablet.cc:2369] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:46:25.262938 26205 raft_consensus.cc:482] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:25.263101 26205 raft_consensus.cc:504] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.263603 26205 leader_election.cc:288] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d11a3b6b21a40e5ba6d15cb1e9d7e88 (127.27.186.67:43225), 36a606a4f9524709b9b71089e2372f9d (127.27.186.65:44901)
I20260811 16:46:25.267904 26197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.263929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:45635 (local address 127.27.186.67:43225)
0811 16:46:25.264030 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:25.264032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:25.264044 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:46:25.264080 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:25.264081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:25.264094 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:25.264174 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:25.264406 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.265186 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.266908 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.267480 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.267568 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.267576 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:25.267768 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 16:46:25.267829 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 16:46:25.267915 25969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.263798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:43225 (local address 127.27.186.66:45635)
0811 16:46:25.263857 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:25.263873 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:25.263975 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:25.264207 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:25.264209 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:25.264211 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:25.264299 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.264300 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.265319 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.265320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.266790 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.266794 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.267598 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.267600 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.267683 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.267688 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:46:25.267752 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 16:46:25.267804 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":58}
I20260811 16:46:25.267974 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.264058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:35763 (local address 127.27.186.65:44901)
0811 16:46:25.264116 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:25.264118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:25.264234 (+ 116us) server_negotiation.cc:407] Connection header received
0811 16:46:25.264269 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:25.264270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:25.264279 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:25.264333 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:25.264541 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.265234 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.266908 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.267480 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.267567 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.267576 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:25.267855 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 16:46:25.267897 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:46:25.267922 26210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.263922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:44901 (local address 127.27.186.66:35763)
0811 16:46:25.264110 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:25.264119 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:25.264212 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:25.264364 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:25.264365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:25.264367 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:25.264441 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.264443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.265319 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.265320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.266791 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:25.266794 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.267703 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.267704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:25.267775 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.267778 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:25.267828 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 16:46:25.267858 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":98,"thread_start_us":115,"threads_started":1}
I20260811 16:46:25.268429 26104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "097048d92e844c9b83cb94f9a5b8542b" candidate_uuid: "737975e227e24ff59c03101fcb23f82a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" is_pre_election: true
I20260811 16:46:25.268425 25676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "097048d92e844c9b83cb94f9a5b8542b" candidate_uuid: "737975e227e24ff59c03101fcb23f82a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a606a4f9524709b9b71089e2372f9d" is_pre_election: true
I20260811 16:46:25.268615 25676 raft_consensus.cc:2454] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737975e227e24ff59c03101fcb23f82a in term 0.
I20260811 16:46:25.268615 26104 raft_consensus.cc:2454] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 737975e227e24ff59c03101fcb23f82a in term 0.
I20260811 16:46:25.268877 25786 leader_election.cc:302] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a606a4f9524709b9b71089e2372f9d, 737975e227e24ff59c03101fcb23f82a; no voters:
I20260811 16:46:25.269047 26205 raft_consensus.cc:2781] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:46:25.269167 26205 raft_consensus.cc:482] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:46:25.269199 26205 raft_consensus.cc:3037] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:25.270112 26205 raft_consensus.cc:504] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.270282 26205 leader_election.cc:288] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [CANDIDATE]: Term 1 election: Requested vote from peers 6d11a3b6b21a40e5ba6d15cb1e9d7e88 (127.27.186.67:43225), 36a606a4f9524709b9b71089e2372f9d (127.27.186.65:44901)
I20260811 16:46:25.270537 26104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "097048d92e844c9b83cb94f9a5b8542b" candidate_uuid: "737975e227e24ff59c03101fcb23f82a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88"
I20260811 16:46:25.270558 25676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "097048d92e844c9b83cb94f9a5b8542b" candidate_uuid: "737975e227e24ff59c03101fcb23f82a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36a606a4f9524709b9b71089e2372f9d"
I20260811 16:46:25.270646 26104 raft_consensus.cc:3037] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:25.270671 25676 raft_consensus.cc:3037] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:25.271466 26104 raft_consensus.cc:2454] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737975e227e24ff59c03101fcb23f82a in term 1.
I20260811 16:46:25.271478 25676 raft_consensus.cc:2454] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 737975e227e24ff59c03101fcb23f82a in term 1.
I20260811 16:46:25.271703 25786 leader_election.cc:302] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d11a3b6b21a40e5ba6d15cb1e9d7e88, 737975e227e24ff59c03101fcb23f82a; no voters:
I20260811 16:46:25.271807 26205 raft_consensus.cc:2781] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:25.271984 26205 raft_consensus.cc:686] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 1 LEADER]: Becoming Leader. State: Replica: 737975e227e24ff59c03101fcb23f82a, State: Running, Role: LEADER
I20260811 16:46:25.272137 26205 consensus_queue.cc:237] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } }
I20260811 16:46:25.273101 25454 catalog_manager.cc:5495] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a reported cstate change: term changed from 0 to 1, leader changed from <none> to 737975e227e24ff59c03101fcb23f82a (127.27.186.66). New cstate: current_term: 1 leader_uuid: "737975e227e24ff59c03101fcb23f82a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "737975e227e24ff59c03101fcb23f82a" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 42617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 } health_report { overall_health: UNKNOWN } } }
W20260811 16:46:25.285522 25760 tablet.cc:2369] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:46:25.290282 26194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.287685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46770 (local address 127.27.186.66:42617)
0811 16:46:25.287758 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:25.287761 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:25.287769 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:46:25.287819 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:25.287820 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:25.287842 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:25.287939 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:46:25.288060 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.288549 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.289329 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:25.289626 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:25.289694 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:25.289857 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:46:25.289981 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:46:25.290113 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:25.290133 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 16:46:25.290157 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:46:25.292361 26104 raft_consensus.cc:1261] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 1 FOLLOWER]: Refusing update from remote peer 737975e227e24ff59c03101fcb23f82a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:25.292394 25676 raft_consensus.cc:1261] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 1 FOLLOWER]: Refusing update from remote peer 737975e227e24ff59c03101fcb23f82a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:25.292788 26205 consensus_queue.cc:1035] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a606a4f9524709b9b71089e2372f9d" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 44901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:25.292953 26211 consensus_queue.cc:1035] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d11a3b6b21a40e5ba6d15cb1e9d7e88" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:25.295663 26214 mvcc.cc:205] Tried to move back new op lower bound from 7317367952554446848 to 7317367952475373568. Current Snapshot: MvccSnapshot[applied={T|T < 7317367952554446848}]
I20260811 16:46:25.296036 26218 mvcc.cc:205] Tried to move back new op lower bound from 7317367952554446848 to 7317367952475373568. Current Snapshot: MvccSnapshot[applied={T|T < 7317367952554446848}]
I20260811 16:46:25.298543 25454 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60382:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:25.298655 25454 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60382:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:25.299445 25454 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6132dc3eda8940cbbc9fd6ac020d7552: Sending DeleteTablet for 3 replicas of tablet 097048d92e844c9b83cb94f9a5b8542b
I20260811 16:46:25.299938 25861 tablet_service.cc:1514] Processing DeleteTablet for tablet 097048d92e844c9b83cb94f9a5b8542b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:25 UTC) from {username='slave'} at 127.0.0.1:40856
I20260811 16:46:25.299960 25644 tablet_service.cc:1514] Processing DeleteTablet for tablet 097048d92e844c9b83cb94f9a5b8542b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:25 UTC) from {username='slave'} at 127.0.0.1:47716
I20260811 16:46:25.300199 26072 tablet_service.cc:1514] Processing DeleteTablet for tablet 097048d92e844c9b83cb94f9a5b8542b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:25 UTC) from {username='slave'} at 127.0.0.1:33246
I20260811 16:46:25.300222 26232 tablet_replica.cc:330] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: stopping tablet replica
I20260811 16:46:25.300397 26232 raft_consensus.cc:2229] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:46:25.300526 26236 tablet_replica.cc:330] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: stopping tablet replica
I20260811 16:46:25.300534 26232 raft_consensus.cc:2258] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:25.300642 26236 raft_consensus.cc:2229] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:25.300700 26230 tablet_replica.cc:330] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d: stopping tablet replica
I20260811 16:46:25.300788 26236 raft_consensus.cc:2258] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:25.300812 26230 raft_consensus.cc:2229] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:25.300983 26230 raft_consensus.cc:2258] T 097048d92e844c9b83cb94f9a5b8542b P 36a606a4f9524709b9b71089e2372f9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:25.301036 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 25545
I20260811 16:46:25.301056 26232 ts_tablet_manager.cc:1905] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:25.303328 26232 ts_tablet_manager.cc:1918] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:25.303411 26232 log.cc:1196] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/097048d92e844c9b83cb94f9a5b8542b
I20260811 16:46:25.303694 26232 ts_tablet_manager.cc:1939] T 097048d92e844c9b83cb94f9a5b8542b P 737975e227e24ff59c03101fcb23f82a: Deleting consensus metadata
I20260811 16:46:25.304283 25436 catalog_manager.cc:4841] TS 737975e227e24ff59c03101fcb23f82a (127.27.186.66:42617): tablet 097048d92e844c9b83cb94f9a5b8542b (table test-table [id=df351457826c41ab9d8a56dd172e37d6]) successfully deleted
I20260811 16:46:25.304879 26236 ts_tablet_manager.cc:1905] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:25.307524 26236 ts_tablet_manager.cc:1918] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:25.307705 26236 log.cc:1196] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/097048d92e844c9b83cb94f9a5b8542b
I20260811 16:46:25.308056 26236 ts_tablet_manager.cc:1939] T 097048d92e844c9b83cb94f9a5b8542b P 6d11a3b6b21a40e5ba6d15cb1e9d7e88: Deleting consensus metadata
I20260811 16:46:25.308626 25438 catalog_manager.cc:4841] TS 6d11a3b6b21a40e5ba6d15cb1e9d7e88 (127.27.186.67:43225): tablet 097048d92e844c9b83cb94f9a5b8542b (table test-table [id=df351457826c41ab9d8a56dd172e37d6]) successfully deleted
W20260811 16:46:25.314499 25438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:44901 (error 108)
I20260811 16:46:25.314752 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 25766
I20260811 16:46:25.319728 26191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:25.314931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:44901 (local address 127.0.0.1:57518)
0811 16:46:25.319601 (+ 4670us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:25.319677 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:44901: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4631}
W20260811 16:46:25.324378 25438 catalog_manager.cc:4584] TS 36a606a4f9524709b9b71089e2372f9d (127.27.186.65:44901): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 097048d92e844c9b83cb94f9a5b8542b: Network error: Client connection negotiation failed: client connection to 127.27.186.65:44901: connect: Connection refused (error 111)
I20260811 16:46:25.337821 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 25970
I20260811 16:46:25.350425 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 25407
2026-08-11T16:46:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (881 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:25 dist-test-slave-gsp7 krb5kdc[26241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:25 dist-test-slave-gsp7 krb5kdc[26241](info): set up 2 sockets
Aug 11 16:46:25 dist-test-slave-gsp7 krb5kdc[26241](info): commencing operation
krb5kdc: starting...
W20260811 16:46:26.635483 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:26 dist-test-slave-gsp7 krb5kdc[26241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:26.767892 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41327
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:41327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:26.852605 26261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:26.852888 26261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:26.852934 26261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:26.854158 26261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:26.854238 26261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:26.854275 26261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:26.854310 26261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:26.854337 26261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:26.855938 26261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:41327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:26.856253 26261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:26.856516 26261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:26.861763 26269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:26.861754 26272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:26.861862 26261 server_base.cc:1034] running on GCE node
W20260811 16:46:26.861754 26270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:26.862576 26261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:26.862843 26261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:26.863991 26261 hybrid_clock.cc:648] HybridClock initialized: now 1786466786863980 us; error 31 us; skew 500 ppm
Aug 11 16:46:26 dist-test-slave-gsp7 krb5kdc[26241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466786, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:26.873733 26261 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:26.874217 26261 webserver.cc:460] Webserver started at http://127.27.186.126:34909/ using document root <none> and password file <none>
I20260811 16:46:26.874470 26261 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:26.874521 26261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:26.874653 26261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:26.875756 26261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "bd16b30f79734d279c32090d362718c1"
format_stamp: "Formatted at 2026-08-11 16:46:26 on dist-test-slave-gsp7"
server_key: "20433fddce65266a7a6a0a48be8da123"
server_key_iv: "51e90d4ebcc1e1b980bef6c323ef9fb9"
server_key_version: "encryptionkey@0"
I20260811 16:46:26.876147 26261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "bd16b30f79734d279c32090d362718c1"
format_stamp: "Formatted at 2026-08-11 16:46:26 on dist-test-slave-gsp7"
server_key: "20433fddce65266a7a6a0a48be8da123"
server_key_iv: "51e90d4ebcc1e1b980bef6c323ef9fb9"
server_key_version: "encryptionkey@0"
I20260811 16:46:26.877763 26261 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:26.878597 26283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:26.878778 26261 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:26.878877 26261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "bd16b30f79734d279c32090d362718c1"
format_stamp: "Formatted at 2026-08-11 16:46:26 on dist-test-slave-gsp7"
server_key: "20433fddce65266a7a6a0a48be8da123"
server_key_iv: "51e90d4ebcc1e1b980bef6c323ef9fb9"
server_key_version: "encryptionkey@0"
I20260811 16:46:26.878964 26261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:26.896003 26261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:26.898065 26261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:26.898218 26261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:26.902650 26261 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:41327
I20260811 16:46:26.902722 26369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:41327 every 8 connection(s)
I20260811 16:46:26.903075 26261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:26.903963 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 26261
I20260811 16:46:26.904086 26371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:26.904104 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:26.904323 28393 external_mini_cluster.cc:1428] Setting key 0a6915f7e44f0c405040206294a78b09
I20260811 16:46:26.907536 26371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1: Bootstrap starting.
I20260811 16:46:26.908360 26371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:26.908682 26371 log.cc:824] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:26.909502 26371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1: No bootstrap required, opened a new log
Aug 11 16:46:26 dist-test-slave-gsp7 krb5kdc[26241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:26.912236 26371 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd16b30f79734d279c32090d362718c1" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41327 } }
I20260811 16:46:26.912438 26371 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:26.912489 26371 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd16b30f79734d279c32090d362718c1, State: Initialized, Role: FOLLOWER
I20260811 16:46:26.912648 26371 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd16b30f79734d279c32090d362718c1" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41327 } }
I20260811 16:46:26.912750 26371 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:26.912788 26371 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:26.912837 26371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:26.913647 26371 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd16b30f79734d279c32090d362718c1" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41327 } }
I20260811 16:46:26.913755 26371 leader_election.cc:302] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd16b30f79734d279c32090d362718c1; no voters:
I20260811 16:46:26.914003 26371 leader_election.cc:288] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:26.914045 26377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:26.914168 26377 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [term 1 LEADER]: Becoming Leader. State: Replica: bd16b30f79734d279c32090d362718c1, State: Running, Role: LEADER
I20260811 16:46:26.914268 26377 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd16b30f79734d279c32090d362718c1" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41327 } }
I20260811 16:46:26.914320 26371 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:26.914816 26377 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd16b30f79734d279c32090d362718c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd16b30f79734d279c32090d362718c1" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41327 } } }
I20260811 16:46:26.914897 26377 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:26.915019 26377 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd16b30f79734d279c32090d362718c1. Latest consensus state: current_term: 1 leader_uuid: "bd16b30f79734d279c32090d362718c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd16b30f79734d279c32090d362718c1" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41327 } } }
I20260811 16:46:26.915081 26377 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:26.915900 26385 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:26.916456 26385 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:26.916746 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:26.904883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39478 (local address 127.27.186.126:41327)
0811 16:46:26.905073 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:26.905080 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:26.905107 (+ 27us) server_negotiation.cc:407] Connection header received
0811 16:46:26.905717 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:26.905725 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:26.905777 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:26.905898 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:26.906748 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:26.907732 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:26.908875 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:26.909308 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:26.909409 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:26.912274 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:26.912284 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:26.912284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:26.912297 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:26.914633 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:26.915137 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:26.915141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:26.915141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:26.915250 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:26.915536 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:26.915537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:26.915537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:26.915891 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:26.916061 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:26.916380 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 16:46:26.916540 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260811 16:46:26.918140 26385 catalog_manager.cc:1347] Generated new cluster ID: a507ddbfc1dd4e61a35e918d236c80b3
I20260811 16:46:26.918200 26385 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:26.930114 26385 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:26.930663 26385 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:26.938278 26385 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1: Generated new TSK 0
I20260811 16:46:26.938483 26385 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:46:26.972579 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41327
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:27.057178 26402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:27.057420 26402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:27.057457 26402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:27.058645 26402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:27.058713 26402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:27.058760 26402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:46:27.060357 26402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:27.060634 26402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:27.060895 26402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:27.065985 26410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.066041 26416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.066010 26407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:27.066092 26402 server_base.cc:1034] running on GCE node
I20260811 16:46:27.066387 26402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:27.066685 26402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:27.067843 26402 hybrid_clock.cc:648] HybridClock initialized: now 1786466787067832 us; error 32 us; skew 500 ppm
Aug 11 16:46:27 dist-test-slave-gsp7 krb5kdc[26241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466787, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:27.070466 26402 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:46:27.070894 26402 webserver.cc:460] Webserver started at http://127.27.186.65:36541/ using document root <none> and password file <none>
I20260811 16:46:27.071122 26402 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:27.071189 26402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:27.071339 26402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:27.072403 26402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "f0d17d6df48847e8bdc7c27de8f7718b"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "ee221fafd3505d45224b7fe2a9be2240"
server_key_iv: "f956745862189cb46084b9943b8c0712"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.072781 26402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "f0d17d6df48847e8bdc7c27de8f7718b"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "ee221fafd3505d45224b7fe2a9be2240"
server_key_iv: "f956745862189cb46084b9943b8c0712"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.074352 26402 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:27.075100 26427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.075268 26402 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:46:27.075371 26402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "f0d17d6df48847e8bdc7c27de8f7718b"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "ee221fafd3505d45224b7fe2a9be2240"
server_key_iv: "f956745862189cb46084b9943b8c0712"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.075449 26402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:27.102458 26402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:27.105042 26402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:27.105223 26402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:27.105505 26402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:27.105842 26402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:27.105894 26402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.105929 26402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:27.105973 26402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.112180 26402 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:43861
I20260811 16:46:27.112238 26596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:43861 every 8 connection(s)
I20260811 16:46:27.112568 26402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:46:27.118907 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 26402
Aug 11 16:46:27 dist-test-slave-gsp7 krb5kdc[26241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466787, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:27.119027 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:46:27.119271 28393 external_mini_cluster.cc:1428] Setting key c4083585f97a776f086155c88394086a
I20260811 16:46:27.123021 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.113323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:58913 (local address 127.27.186.126:41327)
0811 16:46:27.113414 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.113416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.113594 (+ 178us) server_negotiation.cc:407] Connection header received
0811 16:46:27.114110 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.114112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.114123 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.114181 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:27.115261 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.115882 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.116891 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.117103 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.117162 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.119659 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:27.119661 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:27.119662 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:27.119668 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:27.121509 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:27.121950 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:27.121951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:27.121951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:27.122019 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:27.122343 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:27.122343 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:27.122344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:27.122454 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:27.122511 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.122870 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.122954 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 16:46:27.123328 26600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.113269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41327 (local address 127.27.186.65:58913)
0811 16:46:27.113451 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.113509 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.113995 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.114242 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.114245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.114950 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:27.115166 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.115172 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.115972 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.115973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.116793 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.116807 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.117180 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.117181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.117285 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.117870 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:27.117878 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:27.119547 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:27.121596 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:27.121604 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:27.121606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:27.121875 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:27.122099 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:27.122100 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:27.122101 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:27.122268 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:27.122521 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:27.122528 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:27.122705 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.122851 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.123052 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":117,"threads_started":1}
I20260811 16:46:27.123898 26597 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41327
I20260811 16:46:27.124006 26597 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:27.124204 26597 heartbeater.cc:511] Master 127.27.186.126:41327 requested a full tablet report, sending...
I20260811 16:46:27.124775 26313 ts_manager.cc:194] Registered new tserver with Master: f0d17d6df48847e8bdc7c27de8f7718b (127.27.186.65:43861)
I20260811 16:46:27.125553 26313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:58913
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:46:27.147907 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41327
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:27.233134 26605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:27.233350 26605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:27.233374 26605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:27.234594 26605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:27.234643 26605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:27.234669 26605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:46:27.236033 26605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:27.236232 26605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:27.236418 26605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:27.241464 26614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:27.241528 26605 server_base.cc:1034] running on GCE node
W20260811 16:46:27.241494 26613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.241544 26616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:27.241870 26605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:27.242136 26605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:27.243302 26605 hybrid_clock.cc:648] HybridClock initialized: now 1786466787243290 us; error 27 us; skew 500 ppm
Aug 11 16:46:27 dist-test-slave-gsp7 krb5kdc[26241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466787, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:27.245771 26605 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:46:27.246227 26605 webserver.cc:460] Webserver started at http://127.27.186.66:46417/ using document root <none> and password file <none>
I20260811 16:46:27.246450 26605 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:27.246517 26605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:27.246665 26605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:27.247737 26605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "50ff7e55b36f4f2da500e6de7f345875"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "1180bcad00a5fd619d79ade78b114a4c"
server_key_iv: "def284e4a2eceadff0b7ca528b212ee0"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.248112 26605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "50ff7e55b36f4f2da500e6de7f345875"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "1180bcad00a5fd619d79ade78b114a4c"
server_key_iv: "def284e4a2eceadff0b7ca528b212ee0"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.249456 26605 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:46:27.250247 26627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.250409 26605 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:27.250517 26605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "50ff7e55b36f4f2da500e6de7f345875"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "1180bcad00a5fd619d79ade78b114a4c"
server_key_iv: "def284e4a2eceadff0b7ca528b212ee0"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.250591 26605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:27.270998 26605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:27.272927 26605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:27.273113 26605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:27.273371 26605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:27.273834 26605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:27.273887 26605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.273947 26605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:27.273983 26605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.280400 26605 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:40029
I20260811 16:46:27.280489 26812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:40029 every 8 connection(s)
I20260811 16:46:27.280797 26605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:46:27.284307 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 26605
I20260811 16:46:27.284432 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:46:27.284648 28393 external_mini_cluster.cc:1428] Setting key 3baa96872a8fd74bb75387cda13b6066
Aug 11 16:46:27 dist-test-slave-gsp7 krb5kdc[26241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466787, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:27.291919 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.281570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41327 (local address 127.27.186.66:41231)
0811 16:46:27.281755 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.281794 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.282401 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.282662 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.282665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.283262 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:27.283479 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.283484 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.284159 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.284160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.285400 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.285404 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.285813 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.285814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.285970 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.286488 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:27.286498 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:27.288483 (+ 1985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:27.290540 (+ 2057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:27.290551 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:27.290553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:27.290798 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:27.291017 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:27.291017 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:27.291018 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:27.291119 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:27.291409 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:27.291414 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:27.291542 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.291627 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.291747 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":96,"threads_started":1}
I20260811 16:46:27.291913 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.281595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:41231 (local address 127.27.186.126:41327)
0811 16:46:27.281656 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.281658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.281891 (+ 233us) server_negotiation.cc:407] Connection header received
0811 16:46:27.282529 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.282531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.282542 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.282602 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:27.283561 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.284060 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.285530 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.285727 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.285785 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.288606 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:27.288608 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:27.288608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:27.288616 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:27.290403 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:27.290875 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:27.290876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:27.290877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:27.290942 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:27.291185 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:27.291186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:27.291186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:27.291340 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:27.291422 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.291673 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.291770 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:46:27.292613 26814 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41327
I20260811 16:46:27.292728 26814 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:27.292914 26814 heartbeater.cc:511] Master 127.27.186.126:41327 requested a full tablet report, sending...
I20260811 16:46:27.293329 26313 ts_manager.cc:194] Registered new tserver with Master: 50ff7e55b36f4f2da500e6de7f345875 (127.27.186.66:40029)
I20260811 16:46:27.293749 26313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:41231
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:46:27.312434 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41327
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:27.397656 26824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:27.397869 26824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:27.397894 26824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:27.399050 26824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:27.399088 26824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:27.399115 26824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:46:27.400628 26824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:41327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:27.400816 26824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:27.401005 26824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:46:27.406215 26824 server_base.cc:1034] running on GCE node
W20260811 16:46:27.406188 26835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.406158 26837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.406157 26831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:27.406584 26824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:27.406838 26824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:27.407990 26824 hybrid_clock.cc:648] HybridClock initialized: now 1786466787407973 us; error 33 us; skew 500 ppm
Aug 11 16:46:27 dist-test-slave-gsp7 krb5kdc[26241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466787, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:27.410627 26824 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:46:27.411077 26824 webserver.cc:460] Webserver started at http://127.27.186.67:37497/ using document root <none> and password file <none>
I20260811 16:46:27.411324 26824 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:27.411381 26824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:27.411552 26824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:27.412642 26824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "87239d844ba0a86bee307cd35e81b3df"
server_key_iv: "57ad3f56f6514c3838c412d9d8867898"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.413017 26824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "87239d844ba0a86bee307cd35e81b3df"
server_key_iv: "57ad3f56f6514c3838c412d9d8867898"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.414541 26824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 16:46:27.415417 26849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.415606 26824 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:27.415724 26824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "87239d844ba0a86bee307cd35e81b3df"
server_key_iv: "57ad3f56f6514c3838c412d9d8867898"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.415788 26824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:27.426999 26824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:27.429316 26824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:27.429438 26824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:27.429704 26824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:27.429983 26824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:27.430025 26824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.430050 26824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:27.430063 26824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.436380 26824 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:35041
I20260811 16:46:27.436427 27037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:35041 every 8 connection(s)
I20260811 16:46:27.436775 26824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:46:27.438239 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 26824
I20260811 16:46:27.438414 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:46:27.438621 28393 external_mini_cluster.cc:1428] Setting key ad09b7ae618a8241c41a56f974ab99f5
Aug 11 16:46:27 dist-test-slave-gsp7 krb5kdc[26241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466787, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:27.447052 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.437570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:48007 (local address 127.27.186.126:41327)
0811 16:46:27.437635 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.437637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.437864 (+ 227us) server_negotiation.cc:407] Connection header received
0811 16:46:27.438718 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.438720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.438733 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.438775 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:27.440066 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.440581 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.441690 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.441900 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.441984 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.444265 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:27.444267 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:27.444267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:27.444274 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:27.445675 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:27.446100 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:27.446101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:27.446102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:27.446161 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:27.446392 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:27.446393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:27.446393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:27.446510 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:27.446571 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.446868 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.446957 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:46:27.447144 27041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.437567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41327 (local address 127.27.186.67:48007)
0811 16:46:27.437736 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.437776 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.438599 (+ 823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.439010 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.439015 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.439752 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:27.439961 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.439966 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.440683 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.440684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.441606 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.441608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.441998 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.441999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.442140 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.442674 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:27.442683 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:27.444157 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:27.445764 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:27.445772 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:27.445775 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:27.446003 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:27.446228 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:27.446229 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:27.446229 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:27.446334 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:27.446571 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:27.446577 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:27.446703 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.446794 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.446924 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
I20260811 16:46:27.447690 27039 heartbeater.cc:347] Connected to a master server at 127.27.186.126:41327
I20260811 16:46:27.447782 27039 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:27.447944 27039 heartbeater.cc:511] Master 127.27.186.126:41327 requested a full tablet report, sending...
I20260811 16:46:27.448323 26313 ts_manager.cc:194] Registered new tserver with Master: ec8a33853fff481d8a0a2f3f5aa3fd7d (127.27.186.67:35041)
I20260811 16:46:27.448699 26313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:48007
I20260811 16:46:27.450351 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:46:27.457990 26374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.451725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39482 (local address 127.27.186.126:41327)
0811 16:46:27.451764 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.451766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.451864 (+ 98us) server_negotiation.cc:407] Connection header received
0811 16:46:27.451918 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.451918 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.451925 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.451976 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:27.452524 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.452999 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.453845 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.454027 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.454085 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.455381 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:27.455382 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:27.455383 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:27.455389 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:27.456688 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:27.457191 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:27.457192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:27.457193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:27.457253 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:27.457461 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:27.457461 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:27.457462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:27.457662 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:27.457748 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.457865 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.457923 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:46:27.459563 26313 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:46:27.461102 26313 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:46:27.467732 27054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.463494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:43861 (local address 127.0.0.1:37190)
0811 16:46:27.463886 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.463934 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.464012 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.464359 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.464362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.464365 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:27.464440 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.464442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.465342 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.465343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.466588 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.466591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.467417 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.467418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.467503 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.467519 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.467597 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.467648 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":67,"threads_started":1}
I20260811 16:46:27.467762 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.463611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37190 (local address 127.27.186.65:43861)
0811 16:46:27.463903 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.463907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.464110 (+ 203us) server_negotiation.cc:407] Connection header received
0811 16:46:27.464150 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.464152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.464184 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.464256 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:27.464537 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.465236 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.466683 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.467325 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.467404 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.467485 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.467624 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.467666 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":90,"threads_started":1}
I20260811 16:46:27.468179 27056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.463525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:40029 (local address 127.0.0.1:47568)
0811 16:46:27.463925 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.463935 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.464036 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.464432 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.464433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.464435 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:27.464518 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.464520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.465901 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.465902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.466883 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.466885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.467875 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.467876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.467988 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.467994 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.468060 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.468106 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":108,"threads_started":1}
I20260811 16:46:27.468312 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.463651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.27.186.66:40029)
0811 16:46:27.463864 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.463869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.464004 (+ 135us) server_negotiation.cc:407] Connection header received
0811 16:46:27.464147 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.464150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.464171 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.464602 (+ 431us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:27.464683 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.465782 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.466969 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.467708 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.467779 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.467833 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.468092 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.468140 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":85,"threads_started":1}
I20260811 16:46:27.468719 26500 tablet_service.cc:1467] Processing CreateTablet for tablet 71a18bf4240d488d9ae472664f539a55 (DEFAULT_TABLE table=test-table [id=1d5db81174a74af1b55df7c8072ebb26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:27.469153 26500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a18bf4240d488d9ae472664f539a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:27.469184 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.463720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:35041 (local address 127.0.0.1:58556)
0811 16:46:27.464150 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.464159 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.464203 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.464488 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.464488 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.464490 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:27.464540 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.464542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.466955 (+ 2413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.466955 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.467757 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.467760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.468855 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.468856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.468933 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.468945 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.469055 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.469108 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":101,"threads_started":1}
I20260811 16:46:27.469409 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.463873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58556 (local address 127.27.186.67:35041)
0811 16:46:27.464062 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.464065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.464259 (+ 194us) server_negotiation.cc:407] Connection header received
0811 16:46:27.464304 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.464306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.464323 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.464391 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:27.464625 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.465800 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.468069 (+ 2269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.468755 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.468818 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.468853 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.469281 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.469331 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
I20260811 16:46:27.469640 26699 tablet_service.cc:1467] Processing CreateTablet for tablet 71a18bf4240d488d9ae472664f539a55 (DEFAULT_TABLE table=test-table [id=1d5db81174a74af1b55df7c8072ebb26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:27.470038 26699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a18bf4240d488d9ae472664f539a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:27.470106 26932 tablet_service.cc:1467] Processing CreateTablet for tablet 71a18bf4240d488d9ae472664f539a55 (DEFAULT_TABLE table=test-table [id=1d5db81174a74af1b55df7c8072ebb26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:27.470425 26932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71a18bf4240d488d9ae472664f539a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:27.472330 27063 tablet_bootstrap.cc:492] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b: Bootstrap starting.
I20260811 16:46:27.472930 27063 tablet_bootstrap.cc:654] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:27.473428 27063 log.cc:824] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:27.473681 27064 tablet_bootstrap.cc:492] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: Bootstrap starting.
I20260811 16:46:27.474422 27064 tablet_bootstrap.cc:654] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:27.474409 27066 tablet_bootstrap.cc:492] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: Bootstrap starting.
I20260811 16:46:27.475049 27064 log.cc:824] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:27.475082 27063 tablet_bootstrap.cc:492] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b: No bootstrap required, opened a new log
I20260811 16:46:27.475144 27063 ts_tablet_manager.cc:1397] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:46:27.475169 27066 tablet_bootstrap.cc:654] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:27.475751 27066 log.cc:824] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:27.475951 27064 tablet_bootstrap.cc:492] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: No bootstrap required, opened a new log
I20260811 16:46:27.476030 27064 ts_tablet_manager.cc:1397] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:46:27.476534 27066 tablet_bootstrap.cc:492] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: No bootstrap required, opened a new log
I20260811 16:46:27.476612 27066 ts_tablet_manager.cc:1397] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:46:27.477241 27063 raft_consensus.cc:348] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.477555 27063 raft_consensus.cc:374] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:27.477600 27063 raft_consensus.cc:729] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d17d6df48847e8bdc7c27de8f7718b, State: Initialized, Role: FOLLOWER
I20260811 16:46:27.477706 27063 consensus_queue.cc:260] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.477996 27063 ts_tablet_manager.cc:1428] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:46:27.478144 26597 heartbeater.cc:503] Master 127.27.186.126:41327 was elected leader, sending a full tablet report...
I20260811 16:46:27.478174 27064 raft_consensus.cc:348] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.478336 27064 raft_consensus.cc:374] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:27.478360 27064 raft_consensus.cc:729] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ff7e55b36f4f2da500e6de7f345875, State: Initialized, Role: FOLLOWER
I20260811 16:46:27.478495 27064 consensus_queue.cc:260] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.478792 26814 heartbeater.cc:503] Master 127.27.186.126:41327 was elected leader, sending a full tablet report...
I20260811 16:46:27.478776 27064 ts_tablet_manager.cc:1428] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:46:27.478924 27066 raft_consensus.cc:348] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.479113 27066 raft_consensus.cc:374] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:27.479157 27066 raft_consensus.cc:729] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8a33853fff481d8a0a2f3f5aa3fd7d, State: Initialized, Role: FOLLOWER
I20260811 16:46:27.479295 27066 consensus_queue.cc:260] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.479614 27066 ts_tablet_manager.cc:1428] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:46:27.479756 27039 heartbeater.cc:503] Master 127.27.186.126:41327 was elected leader, sending a full tablet report...
I20260811 16:46:27.479849 27076 raft_consensus.cc:482] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:27.479933 27076 raft_consensus.cc:504] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.480283 27076 leader_election.cc:288] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0d17d6df48847e8bdc7c27de8f7718b (127.27.186.65:43861), ec8a33853fff481d8a0a2f3f5aa3fd7d (127.27.186.67:35041)
I20260811 16:46:27.483719 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.480606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:50117 (local address 127.27.186.67:35041)
0811 16:46:27.480649 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.480651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.480779 (+ 128us) server_negotiation.cc:407] Connection header received
0811 16:46:27.480894 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.480895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.480906 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.480980 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:27.481156 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.481781 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.482999 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.483374 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.483431 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.483459 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.483605 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.483651 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:46:27.483757 27057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.480474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:50495 (local address 127.27.186.65:43861)
0811 16:46:27.480601 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.480603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.480767 (+ 164us) server_negotiation.cc:407] Connection header received
0811 16:46:27.480837 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.480838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.480847 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.480895 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:27.481225 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.481847 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.483008 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.483385 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.483472 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.483481 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.483656 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.483696 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 16:46:27.483747 27079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.480536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:35041 (local address 127.27.186.66:50117)
0811 16:46:27.480717 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.480729 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.480805 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.480991 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.480992 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.480994 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:27.481065 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.481066 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.481857 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.481858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.482904 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.482907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.483454 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.483455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.483529 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.483533 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.483586 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.483632 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":34,"thread_start_us":89,"threads_started":1}
I20260811 16:46:27.483814 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.480429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:43861 (local address 127.27.186.66:50495)
0811 16:46:27.480663 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.480700 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.480783 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.480945 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.480946 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.480947 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:27.481128 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.481131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.481945 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.481947 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.482909 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.482911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.483489 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.483490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.483564 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.483581 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.483640 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.483676 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":27}
I20260811 16:46:27.484102 26963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a18bf4240d488d9ae472664f539a55" candidate_uuid: "50ff7e55b36f4f2da500e6de7f345875" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" is_pre_election: true
I20260811 16:46:27.484267 26963 raft_consensus.cc:2454] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50ff7e55b36f4f2da500e6de7f345875 in term 0.
I20260811 16:46:27.484530 26632 leader_election.cc:302] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ff7e55b36f4f2da500e6de7f345875, ec8a33853fff481d8a0a2f3f5aa3fd7d; no voters:
I20260811 16:46:27.484575 26527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a18bf4240d488d9ae472664f539a55" candidate_uuid: "50ff7e55b36f4f2da500e6de7f345875" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" is_pre_election: true
I20260811 16:46:27.484728 26527 raft_consensus.cc:2454] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50ff7e55b36f4f2da500e6de7f345875 in term 0.
I20260811 16:46:27.484740 27076 raft_consensus.cc:2781] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:46:27.484799 27076 raft_consensus.cc:482] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:46:27.484834 27076 raft_consensus.cc:3037] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:27.485601 27076 raft_consensus.cc:504] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.485731 27076 leader_election.cc:288] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [CANDIDATE]: Term 1 election: Requested vote from peers f0d17d6df48847e8bdc7c27de8f7718b (127.27.186.65:43861), ec8a33853fff481d8a0a2f3f5aa3fd7d (127.27.186.67:35041)
I20260811 16:46:27.485896 26527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a18bf4240d488d9ae472664f539a55" candidate_uuid: "50ff7e55b36f4f2da500e6de7f345875" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d17d6df48847e8bdc7c27de8f7718b"
I20260811 16:46:27.485905 26963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71a18bf4240d488d9ae472664f539a55" candidate_uuid: "50ff7e55b36f4f2da500e6de7f345875" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d"
I20260811 16:46:27.485966 26963 raft_consensus.cc:3037] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:27.485992 26527 raft_consensus.cc:3037] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:27.486702 26527 raft_consensus.cc:2454] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50ff7e55b36f4f2da500e6de7f345875 in term 1.
I20260811 16:46:27.486718 26963 raft_consensus.cc:2454] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50ff7e55b36f4f2da500e6de7f345875 in term 1.
I20260811 16:46:27.486889 26632 leader_election.cc:302] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ff7e55b36f4f2da500e6de7f345875, ec8a33853fff481d8a0a2f3f5aa3fd7d; no voters:
I20260811 16:46:27.486997 27076 raft_consensus.cc:2781] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:27.487145 27076 raft_consensus.cc:686] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 1 LEADER]: Becoming Leader. State: Replica: 50ff7e55b36f4f2da500e6de7f345875, State: Running, Role: LEADER
I20260811 16:46:27.487264 27076 consensus_queue.cc:237] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } }
I20260811 16:46:27.488149 26313 catalog_manager.cc:5495] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50ff7e55b36f4f2da500e6de7f345875 (127.27.186.66). New cstate: current_term: 1 leader_uuid: "50ff7e55b36f4f2da500e6de7f345875" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50ff7e55b36f4f2da500e6de7f345875" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40029 } health_report { overall_health: HEALTHY } } }
I20260811 16:46:27.498169 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.495711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47584 (local address 127.27.186.66:40029)
0811 16:46:27.495761 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.495764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.495775 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:46:27.495824 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.495825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.495847 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.495920 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:46:27.496071 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.496544 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.497315 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.497576 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.497648 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.497814 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:46:27.497915 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:46:27.498023 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.498074 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.498086 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:46:27.500118 26963 raft_consensus.cc:1261] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 1 FOLLOWER]: Refusing update from remote peer 50ff7e55b36f4f2da500e6de7f345875: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:27.500118 26527 raft_consensus.cc:1261] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 1 FOLLOWER]: Refusing update from remote peer 50ff7e55b36f4f2da500e6de7f345875: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:27.500505 27076 consensus_queue.cc:1035] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0d17d6df48847e8bdc7c27de8f7718b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:27.500662 27080 consensus_queue.cc:1035] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec8a33853fff481d8a0a2f3f5aa3fd7d" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:27.503818 27094 mvcc.cc:205] Tried to move back new op lower bound from 7317367961597476864 to 7317367961548582912. Current Snapshot: MvccSnapshot[applied={T|T < 7317367961597476864}]
I20260811 16:46:27.506323 26313 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:27.506409 26313 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:27.507133 26313 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd16b30f79734d279c32090d362718c1: Sending DeleteTablet for 3 replicas of tablet 71a18bf4240d488d9ae472664f539a55
I20260811 16:46:27.507503 26500 tablet_service.cc:1514] Processing DeleteTablet for tablet 71a18bf4240d488d9ae472664f539a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:27 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:37190
I20260811 16:46:27.507573 26932 tablet_service.cc:1514] Processing DeleteTablet for tablet 71a18bf4240d488d9ae472664f539a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:27 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:58556
I20260811 16:46:27.507771 27106 tablet_replica.cc:330] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: stopping tablet replica
I20260811 16:46:27.507769 26699 tablet_service.cc:1514] Processing DeleteTablet for tablet 71a18bf4240d488d9ae472664f539a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:27 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:47568
I20260811 16:46:27.507884 27106 raft_consensus.cc:2229] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:27.508004 27106 raft_consensus.cc:2258] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:27.508031 27108 tablet_replica.cc:330] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: stopping tablet replica
I20260811 16:46:27.508212 27108 raft_consensus.cc:2229] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:46:27.508255 27105 tablet_replica.cc:330] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b: stopping tablet replica
I20260811 16:46:27.508332 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 26402
I20260811 16:46:27.508373 27105 raft_consensus.cc:2229] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:27.508482 27105 raft_consensus.cc:2258] T 71a18bf4240d488d9ae472664f539a55 P f0d17d6df48847e8bdc7c27de8f7718b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:27.508502 27108 raft_consensus.cc:2258] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:27.509505 27108 ts_tablet_manager.cc:1905] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:27.512135 27108 ts_tablet_manager.cc:1918] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:27.512279 27108 log.cc:1196] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/71a18bf4240d488d9ae472664f539a55
I20260811 16:46:27.512657 27108 ts_tablet_manager.cc:1939] T 71a18bf4240d488d9ae472664f539a55 P 50ff7e55b36f4f2da500e6de7f345875: Deleting consensus metadata
I20260811 16:46:27.513167 26285 catalog_manager.cc:4841] TS 50ff7e55b36f4f2da500e6de7f345875 (127.27.186.66:40029): tablet 71a18bf4240d488d9ae472664f539a55 (table test-table [id=1d5db81174a74af1b55df7c8072ebb26]) successfully deleted
I20260811 16:46:27.523947 27106 ts_tablet_manager.cc:1905] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:27.526611 27106 ts_tablet_manager.cc:1918] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:27.526732 27106 log.cc:1196] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/71a18bf4240d488d9ae472664f539a55
I20260811 16:46:27.527119 27106 ts_tablet_manager.cc:1939] T 71a18bf4240d488d9ae472664f539a55 P ec8a33853fff481d8a0a2f3f5aa3fd7d: Deleting consensus metadata
I20260811 16:46:27.528288 26296 catalog_manager.cc:4841] TS ec8a33853fff481d8a0a2f3f5aa3fd7d (127.27.186.67:35041): tablet 71a18bf4240d488d9ae472664f539a55 (table test-table [id=1d5db81174a74af1b55df7c8072ebb26]) successfully deleted
W20260811 16:46:27.532971 26296 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:43861 (error 108)
I20260811 16:46:27.533207 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 26605
I20260811 16:46:27.538059 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.537903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:43861 (local address 127.0.0.1:37200)
0811 16:46:27.537962 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.538011 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 16:46:27.538196 26296 catalog_manager.cc:4584] TS f0d17d6df48847e8bdc7c27de8f7718b (127.27.186.65:43861): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 71a18bf4240d488d9ae472664f539a55: Network error: Client connection negotiation failed: client connection to 127.27.186.65:43861: connect: Connection refused (error 111)
I20260811 16:46:27.547310 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 26824
I20260811 16:46:27.565686 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 26261
2026-08-11T16:46:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2221 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T16:46:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:27Z Disabled control of system clock
I20260811 16:46:27.607486 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45531
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:45799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:45531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:27.690766 27118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:27.691011 27118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:27.691035 27118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:27.692306 27118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:27.692353 27118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:27.692365 27118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:27.692378 27118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:27.692392 27118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:27.693804 27118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:45531
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:27.694083 27118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:27.694413 27118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:27.699436 27128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.699419 27127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.699393 27132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:27.699815 27118 server_base.cc:1034] running on GCE node
I20260811 16:46:27.700088 27118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:27.700445 27118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:27.701609 27118 hybrid_clock.cc:648] HybridClock initialized: now 1786466787701607 us; error 43 us; skew 500 ppm
I20260811 16:46:27.702888 27118 webserver.cc:460] Webserver started at http://127.27.186.126:38647/ using document root <none> and password file <none>
I20260811 16:46:27.703154 27118 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:27.703223 27118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:27.703357 27118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:27.704489 27118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "66dee15180eb4781b45ced5a903b7829"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "fd8680f2843558d67fd0014f1fdbe67c"
server_key_iv: "f947fd52a985eaf5af320ee00c44abed"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.704869 27118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "66dee15180eb4781b45ced5a903b7829"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "fd8680f2843558d67fd0014f1fdbe67c"
server_key_iv: "f947fd52a985eaf5af320ee00c44abed"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.706383 27118 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:27.707309 27140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.707541 27118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:27.707662 27118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "66dee15180eb4781b45ced5a903b7829"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "fd8680f2843558d67fd0014f1fdbe67c"
server_key_iv: "f947fd52a985eaf5af320ee00c44abed"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.707746 27118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:27.722553 27118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:27.722918 27118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:27.723084 27118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:27.727891 27118 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:45531
I20260811 16:46:27.727922 27228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:45531 every 8 connection(s)
I20260811 16:46:27.728329 27118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:27.729334 27230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:27.731752 27230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829: Bootstrap starting.
I20260811 16:46:27.732386 27230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:27.732389 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 27118
I20260811 16:46:27.732489 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:27.732717 28393 external_mini_cluster.cc:1428] Setting key d7acaad8ae1f72fc55fa2b6535f1cc56
I20260811 16:46:27.732775 27230 log.cc:824] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:27.733667 27230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829: No bootstrap required, opened a new log
I20260811 16:46:27.736817 27230 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dee15180eb4781b45ced5a903b7829" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45531 } }
I20260811 16:46:27.736971 27230 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:27.736996 27230 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66dee15180eb4781b45ced5a903b7829, State: Initialized, Role: FOLLOWER
I20260811 16:46:27.737191 27230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dee15180eb4781b45ced5a903b7829" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45531 } }
I20260811 16:46:27.737286 27230 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:27.737334 27230 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:27.737385 27230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:27.737993 27230 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dee15180eb4781b45ced5a903b7829" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45531 } }
I20260811 16:46:27.738116 27230 leader_election.cc:302] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66dee15180eb4781b45ced5a903b7829; no voters:
I20260811 16:46:27.738317 27230 leader_election.cc:288] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:27.738348 27239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:27.738485 27239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [term 1 LEADER]: Becoming Leader. State: Replica: 66dee15180eb4781b45ced5a903b7829, State: Running, Role: LEADER
I20260811 16:46:27.738574 27239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dee15180eb4781b45ced5a903b7829" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45531 } }
I20260811 16:46:27.738622 27230 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:27.738897 27241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66dee15180eb4781b45ced5a903b7829" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dee15180eb4781b45ced5a903b7829" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45531 } } }
I20260811 16:46:27.738981 27241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:27.739185 27242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66dee15180eb4781b45ced5a903b7829. Latest consensus state: current_term: 1 leader_uuid: "66dee15180eb4781b45ced5a903b7829" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66dee15180eb4781b45ced5a903b7829" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45531 } } }
I20260811 16:46:27.739267 27242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:27.739400 27247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:27.739601 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.733284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43872 (local address 127.27.186.126:45531)
0811 16:46:27.733539 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.733549 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.733585 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:46:27.734217 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.734228 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.734322 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.734494 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:27.734702 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.736314 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.737141 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.737678 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.737812 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.738666 (+ 854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:27.738671 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:27.738671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:27.738895 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:27.738941 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:27.738969 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:27.739013 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.739304 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.739403 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":88,"threads_started":1}
I20260811 16:46:27.740154 27247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:27.742120 27247 catalog_manager.cc:1347] Generated new cluster ID: 7f7aa91dc0af4f268d406b36c77a8d81
I20260811 16:46:27.742180 27247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:27.755133 27247 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:27.755702 27247 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:27.762869 27247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829: Generated new TSK 0
I20260811 16:46:27.763075 27247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:27.766937 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45531
--builtin_ntp_servers=127.27.186.84:45799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:27.862169 27269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:27.862391 27269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:27.862416 27269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:27.863718 27269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:27.863765 27269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:27.863791 27269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:46:27.865165 27269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:27.865422 27269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:27.865855 27269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:27.871569 27282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.871486 27286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:27.871495 27279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:27.871821 27269 server_base.cc:1034] running on GCE node
I20260811 16:46:27.872068 27269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:27.872330 27269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:27.873541 27269 hybrid_clock.cc:648] HybridClock initialized: now 1786466787873513 us; error 41 us; skew 500 ppm
I20260811 16:46:27.875118 27269 webserver.cc:460] Webserver started at http://127.27.186.65:36779/ using document root <none> and password file <none>
I20260811 16:46:27.875391 27269 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:27.875458 27269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:27.875614 27269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:27.876820 27269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "01ed660a636541758f9262159cf738ea"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "d5ebab3f316295251211b33beb2b42d9"
server_key_iv: "3131d2bfb21ac58dfb11c7a43aa7ecbe"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.877197 27269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "01ed660a636541758f9262159cf738ea"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "d5ebab3f316295251211b33beb2b42d9"
server_key_iv: "3131d2bfb21ac58dfb11c7a43aa7ecbe"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.878686 27269 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:27.879494 27300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.879698 27269 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:27.879804 27269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "01ed660a636541758f9262159cf738ea"
format_stamp: "Formatted at 2026-08-11 16:46:27 on dist-test-slave-gsp7"
server_key: "d5ebab3f316295251211b33beb2b42d9"
server_key_iv: "3131d2bfb21ac58dfb11c7a43aa7ecbe"
server_key_version: "encryptionkey@0"
I20260811 16:46:27.879876 27269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:27.921015 27269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:27.921365 27269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:27.921581 27269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:27.921844 27269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:27.922163 27269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:27.922199 27269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.922222 27269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:27.922235 27269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:27.929160 27269 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:40163
I20260811 16:46:27.929203 27486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:40163 every 8 connection(s)
I20260811 16:46:27.929593 27269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:46:27.934037 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 27269
I20260811 16:46:27.934142 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:46:27.934365 28393 external_mini_cluster.cc:1428] Setting key ffc181151b48bf0f383b9911c10168f3
I20260811 16:46:27.935160 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.930321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:49143 (local address 127.27.186.126:45531)
0811 16:46:27.930387 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:27.930390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:27.930653 (+ 263us) server_negotiation.cc:407] Connection header received
0811 16:46:27.931208 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:27.931209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:27.931220 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:27.931284 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:27.931996 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.932508 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.933465 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.933725 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.933818 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.934866 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:27.934868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:27.934868 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:27.934873 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:27.934890 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:27.934894 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:27.934964 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:27.935042 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 16:46:27.935070 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 16:46:27.935417 27492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:27.930318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45531 (local address 127.27.186.65:49143)
0811 16:46:27.930526 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:27.930563 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:27.931089 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:27.931370 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:27.931373 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:27.931382 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:27.931907 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.931911 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.932588 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.932589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.933376 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:27.933378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:27.933811 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:27.933812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:27.933997 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:27.934702 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:27.934703 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:27.934742 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:27.934771 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:27.934965 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:27.934967 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:27.934970 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:27.935047 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:46:27.935170 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260811 16:46:27.935493 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45531
--builtin_ntp_servers=127.27.186.84:45799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:46:27.936044 27487 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45531
I20260811 16:46:27.936161 27487 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:27.936343 27487 heartbeater.cc:511] Master 127.27.186.126:45531 requested a full tablet report, sending...
I20260811 16:46:27.936863 27173 ts_manager.cc:194] Registered new tserver with Master: 01ed660a636541758f9262159cf738ea (127.27.186.65:40163)
I20260811 16:46:27.937551 27173 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.65:49143
W20260811 16:46:28.020188 27493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:28.020458 27493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:28.020501 27493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:28.021667 27493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:28.021730 27493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:28.021775 27493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:46:28.023134 27493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:28.023391 27493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:28.023698 27493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:28.028865 27503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:28.028905 27501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:28.028961 27493 server_base.cc:1034] running on GCE node
W20260811 16:46:28.028939 27500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:28.029322 27493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:28.029593 27493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:28.030766 27493 hybrid_clock.cc:648] HybridClock initialized: now 1786466788030747 us; error 36 us; skew 500 ppm
I20260811 16:46:28.032143 27493 webserver.cc:460] Webserver started at http://127.27.186.66:38515/ using document root <none> and password file <none>
I20260811 16:46:28.032410 27493 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:28.032459 27493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:28.032606 27493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:28.033802 27493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "2705c965988144d29965c85254445413"
format_stamp: "Formatted at 2026-08-11 16:46:28 on dist-test-slave-gsp7"
server_key: "f0bc3ca68b718190630db452b19a0c86"
server_key_iv: "a5ff044dcd1e77226ef8f14e11ae7e80"
server_key_version: "encryptionkey@0"
I20260811 16:46:28.034168 27493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "2705c965988144d29965c85254445413"
format_stamp: "Formatted at 2026-08-11 16:46:28 on dist-test-slave-gsp7"
server_key: "f0bc3ca68b718190630db452b19a0c86"
server_key_iv: "a5ff044dcd1e77226ef8f14e11ae7e80"
server_key_version: "encryptionkey@0"
I20260811 16:46:28.035614 27493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:28.036355 27517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:28.036526 27493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:28.036623 27493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "2705c965988144d29965c85254445413"
format_stamp: "Formatted at 2026-08-11 16:46:28 on dist-test-slave-gsp7"
server_key: "f0bc3ca68b718190630db452b19a0c86"
server_key_iv: "a5ff044dcd1e77226ef8f14e11ae7e80"
server_key_version: "encryptionkey@0"
I20260811 16:46:28.036703 27493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:28.055994 27493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:28.056383 27493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:28.056555 27493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:28.056821 27493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:28.057196 27493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:28.057251 27493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:28.057288 27493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:28.057329 27493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:28.063705 27493 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:39407
I20260811 16:46:28.063753 27702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:39407 every 8 connection(s)
I20260811 16:46:28.064114 27493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:46:28.069669 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.064905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:37611 (local address 127.27.186.126:45531)
0811 16:46:28.064977 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.064980 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.065253 (+ 273us) server_negotiation.cc:407] Connection header received
0811 16:46:28.065878 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.065879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.065891 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.065953 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:28.066693 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.067219 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.068282 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.068490 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.068551 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.069377 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:28.069378 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:28.069378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:28.069383 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:28.069397 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:28.069402 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:28.069447 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.069582 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.069606 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:46:28.069908 27705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.064887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45531 (local address 127.27.186.66:37611)
0811 16:46:28.065121 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:28.065160 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:28.065764 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:28.066039 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:28.066043 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:28.066052 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:28.066587 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.066591 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.067338 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.067338 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.068182 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.068185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.068579 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.068579 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.068697 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.069239 (+ 542us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:28.069239 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:28.069268 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:28.069291 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:28.069456 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:28.069460 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:28.069463 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:28.069577 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 16:46:28.069661 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":121,"threads_started":1}
I20260811 16:46:28.070519 27703 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45531
I20260811 16:46:28.070616 27703 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:28.070834 27703 heartbeater.cc:511] Master 127.27.186.126:45531 requested a full tablet report, sending...
I20260811 16:46:28.071230 27173 ts_manager.cc:194] Registered new tserver with Master: 2705c965988144d29965c85254445413 (127.27.186.66:39407)
I20260811 16:46:28.071595 27173 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.66:37611
I20260811 16:46:28.071995 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 27493
I20260811 16:46:28.072108 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:46:28.072314 28393 external_mini_cluster.cc:1428] Setting key da96168ca15babba49279e789bb026ac
I20260811 16:46:28.073226 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45531
--builtin_ntp_servers=127.27.186.84:45799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:28.159152 27706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:28.159405 27706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:28.159442 27706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:28.160594 27706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:28.160660 27706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:28.160702 27706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:46:28.162104 27706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:45799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:45531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:28.162369 27706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:28.162679 27706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:46:28.168027 27706 server_base.cc:1034] running on GCE node
W20260811 16:46:28.168031 27712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:28.168069 27722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:28.168023 27713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:28.168486 27706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:28.168694 27706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:28.169834 27706 hybrid_clock.cc:648] HybridClock initialized: now 1786466788169821 us; error 32 us; skew 500 ppm
I20260811 16:46:28.171183 27706 webserver.cc:460] Webserver started at http://127.27.186.67:40749/ using document root <none> and password file <none>
I20260811 16:46:28.171433 27706 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:28.171480 27706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:28.171671 27706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:28.172791 27706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "ac11ffd2d96c45fcace837f70fcc76ac"
format_stamp: "Formatted at 2026-08-11 16:46:28 on dist-test-slave-gsp7"
server_key: "528757c4672e486febd2367c158f294a"
server_key_iv: "1095ebd119ca1167dd20e81f6b48cd6c"
server_key_version: "encryptionkey@0"
I20260811 16:46:28.173166 27706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "ac11ffd2d96c45fcace837f70fcc76ac"
format_stamp: "Formatted at 2026-08-11 16:46:28 on dist-test-slave-gsp7"
server_key: "528757c4672e486febd2367c158f294a"
server_key_iv: "1095ebd119ca1167dd20e81f6b48cd6c"
server_key_version: "encryptionkey@0"
I20260811 16:46:28.174614 27706 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:28.175434 27731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:28.175613 27706 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:28.175730 27706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "ac11ffd2d96c45fcace837f70fcc76ac"
format_stamp: "Formatted at 2026-08-11 16:46:28 on dist-test-slave-gsp7"
server_key: "528757c4672e486febd2367c158f294a"
server_key_iv: "1095ebd119ca1167dd20e81f6b48cd6c"
server_key_version: "encryptionkey@0"
I20260811 16:46:28.175817 27706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:28.193919 27706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:28.194281 27706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:28.194445 27706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:28.194697 27706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:28.195063 27706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:28.195119 27706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:28.195156 27706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:28.195197 27706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:28.201555 27706 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:40347
I20260811 16:46:28.201607 27913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:40347 every 8 connection(s)
I20260811 16:46:28.202008 27706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:46:28.207428 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.202834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:34385 (local address 127.27.186.126:45531)
0811 16:46:28.202902 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.202905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.203168 (+ 263us) server_negotiation.cc:407] Connection header received
0811 16:46:28.203726 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.203728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.203741 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.203795 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:28.204495 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.204996 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.206049 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.206244 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.206326 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.207143 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:28.207145 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:28.207146 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:28.207151 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:28.207166 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:28.207172 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:28.207226 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.207339 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.207362 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:46:28.207703 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.202817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:45531 (local address 127.27.186.67:34385)
0811 16:46:28.203042 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:28.203078 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:28.203614 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:28.203871 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:28.203880 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:28.203888 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:28.204388 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.204394 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.205091 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.205092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.205948 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.205951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.206339 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.206340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.206472 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.207006 (+ 534us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:28.207006 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:28.207034 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:28.207057 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:28.207251 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:28.207258 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:28.207261 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:28.207333 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 16:46:28.207432 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":92,"threads_started":1}
I20260811 16:46:28.208222 27915 heartbeater.cc:347] Connected to a master server at 127.27.186.126:45531
I20260811 16:46:28.208325 27915 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:28.208559 27915 heartbeater.cc:511] Master 127.27.186.126:45531 requested a full tablet report, sending...
I20260811 16:46:28.208922 27173 ts_manager.cc:194] Registered new tserver with Master: ac11ffd2d96c45fcace837f70fcc76ac (127.27.186.67:40347)
I20260811 16:46:28.209254 27173 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.67:34385
I20260811 16:46:28.209792 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 27706
I20260811 16:46:28.209906 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:46:28.210142 28393 external_mini_cluster.cc:1428] Setting key 78ad7dee4d046245c1f81c563fa50360
I20260811 16:46:28.211099 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:46:28.215806 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.212638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43886 (local address 127.27.186.126:45531)
0811 16:46:28.212709 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.212711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.212851 (+ 140us) server_negotiation.cc:407] Connection header received
0811 16:46:28.212954 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.212955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.212965 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.213011 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:28.213166 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.213720 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.214474 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.214663 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.214743 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.215498 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:28.215499 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:28.215500 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:28.215504 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:28.215522 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:28.215527 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:28.215619 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.215710 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.215721 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:46:28.217389 27173 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43886:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:46:28.219121 27173 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:46:28.225775 27931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.221852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40202 (local address 127.27.186.66:39407)
0811 16:46:28.222554 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.222558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.222568 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:46:28.222608 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.222609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.222623 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.222707 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:28.222836 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.223560 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.224804 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.225330 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.225422 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.225558 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.225635 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.225676 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":125,"threads_started":1}
I20260811 16:46:28.225759 27926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.221642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:39407 (local address 127.0.0.1:40202)
0811 16:46:28.222106 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:28.222144 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:28.222220 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:28.222707 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:28.222708 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:28.222710 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:28.222773 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.222775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.223654 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.223655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.224712 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.224714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.225424 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.225425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.225525 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.225539 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 16:46:28.225620 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 16:46:28.225676 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":2,"thread_start_us":80,"threads_started":1}
I20260811 16:46:28.226759 27930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.221642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40347 (local address 127.0.0.1:37196)
0811 16:46:28.222064 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:28.222189 (+ 125us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:28.222375 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:28.222616 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:28.222620 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:28.222623 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:28.222713 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.222716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.224154 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.224155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.225337 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.225341 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.226494 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.226495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.226568 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.226573 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:46:28.226624 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:46:28.226667 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"mutex_wait_us":56,"thread_start_us":82,"threads_started":1}
I20260811 16:46:28.226949 27933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.222140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34646 (local address 127.27.186.65:40163)
0811 16:46:28.222355 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.222360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.222530 (+ 170us) server_negotiation.cc:407] Connection header received
0811 16:46:28.222639 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.222646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.222668 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.222760 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:28.222948 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.224054 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.225701 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.226436 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.226501 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.226585 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.226800 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.226846 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":119,"threads_started":1}
I20260811 16:46:28.226912 27591 tablet_service.cc:1467] Processing CreateTablet for tablet 515c000559fb456d9a8933f14d9580f1 (DEFAULT_TABLE table=test-table [id=c637ae4e0c6b43a79a2059919c32a83e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:28.227113 27929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.221764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37196 (local address 127.27.186.67:40347)
0811 16:46:28.221950 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.221969 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.222341 (+ 372us) server_negotiation.cc:407] Connection header received
0811 16:46:28.222466 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.222469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.222489 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.222581 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:28.222810 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.224001 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.225462 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.226221 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.226295 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.226381 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.226961 (+ 580us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.227014 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":103,"threads_started":1}
I20260811 16:46:28.227200 27928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.221878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:40163 (local address 127.0.0.1:34646)
0811 16:46:28.222359 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:28.222370 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:28.222443 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:28.222834 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:28.222835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:28.222837 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:28.222875 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.222876 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.224147 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.224149 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.225609 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.225612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.226618 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.226619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.226671 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.226675 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:46:28.226720 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 16:46:28.226752 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":54,"thread_start_us":96,"threads_started":1}
I20260811 16:46:28.227350 27591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 515c000559fb456d9a8933f14d9580f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:28.227888 27811 tablet_service.cc:1467] Processing CreateTablet for tablet 515c000559fb456d9a8933f14d9580f1 (DEFAULT_TABLE table=test-table [id=c637ae4e0c6b43a79a2059919c32a83e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:28.227910 27360 tablet_service.cc:1467] Processing CreateTablet for tablet 515c000559fb456d9a8933f14d9580f1 (DEFAULT_TABLE table=test-table [id=c637ae4e0c6b43a79a2059919c32a83e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:28.228253 27360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 515c000559fb456d9a8933f14d9580f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:28.228255 27811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 515c000559fb456d9a8933f14d9580f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:28.230146 27934 tablet_bootstrap.cc:492] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Bootstrap starting.
I20260811 16:46:28.230849 27934 tablet_bootstrap.cc:654] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:28.231096 27934 log.cc:824] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:28.231729 27940 tablet_bootstrap.cc:492] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: Bootstrap starting.
I20260811 16:46:28.231875 27934 tablet_bootstrap.cc:492] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: No bootstrap required, opened a new log
I20260811 16:46:28.231949 27934 ts_tablet_manager.cc:1397] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:46:28.232445 27940 tablet_bootstrap.cc:654] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:28.232846 27940 log.cc:824] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:28.233263 27943 tablet_bootstrap.cc:492] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea: Bootstrap starting.
I20260811 16:46:28.233902 27940 tablet_bootstrap.cc:492] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: No bootstrap required, opened a new log
I20260811 16:46:28.233994 27940 ts_tablet_manager.cc:1397] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:46:28.234010 27943 tablet_bootstrap.cc:654] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:28.234351 27943 log.cc:824] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:28.234925 27934 raft_consensus.cc:348] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.235129 27934 raft_consensus.cc:374] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:28.235178 27934 raft_consensus.cc:729] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2705c965988144d29965c85254445413, State: Initialized, Role: FOLLOWER
I20260811 16:46:28.235249 27943 tablet_bootstrap.cc:492] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea: No bootstrap required, opened a new log
I20260811 16:46:28.235314 27943 ts_tablet_manager.cc:1397] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:46:28.235306 27934 consensus_queue.cc:260] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.235592 27934 ts_tablet_manager.cc:1428] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 16:46:28.235759 27703 heartbeater.cc:503] Master 127.27.186.126:45531 was elected leader, sending a full tablet report...
I20260811 16:46:28.236670 27940 raft_consensus.cc:348] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.236848 27940 raft_consensus.cc:374] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:28.236892 27940 raft_consensus.cc:729] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac11ffd2d96c45fcace837f70fcc76ac, State: Initialized, Role: FOLLOWER
I20260811 16:46:28.237025 27940 consensus_queue.cc:260] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.237303 27940 ts_tablet_manager.cc:1428] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:46:28.237352 27915 heartbeater.cc:503] Master 127.27.186.126:45531 was elected leader, sending a full tablet report...
I20260811 16:46:28.238157 27943 raft_consensus.cc:348] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.238339 27943 raft_consensus.cc:374] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:28.238391 27943 raft_consensus.cc:729] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01ed660a636541758f9262159cf738ea, State: Initialized, Role: FOLLOWER
I20260811 16:46:28.238523 27943 consensus_queue.cc:260] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.238816 27487 heartbeater.cc:503] Master 127.27.186.126:45531 was elected leader, sending a full tablet report...
I20260811 16:46:28.238834 27943 ts_tablet_manager.cc:1428] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 16:46:28.309041 27948 raft_consensus.cc:482] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:28.309181 27948 raft_consensus.cc:504] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.309614 27948 leader_election.cc:288] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac11ffd2d96c45fcace837f70fcc76ac (127.27.186.67:40347), 2705c965988144d29965c85254445413 (127.27.186.66:39407)
I20260811 16:46:28.313506 27929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.309852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:48949 (local address 127.27.186.67:40347)
0811 16:46:28.309915 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.309918 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.309951 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:46:28.309986 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.309987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.309998 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.310067 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:28.310285 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.311071 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.312503 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.313116 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.313185 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.313193 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.313376 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.313415 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:46:28.313506 27931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.309955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:47019 (local address 127.27.186.66:39407)
0811 16:46:28.310006 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.310009 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.310082 (+ 73us) server_negotiation.cc:407] Connection header received
0811 16:46:28.310199 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.310201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.310212 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.310276 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:28.310413 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.311135 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.312527 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.313097 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.313185 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.313193 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.313366 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.313409 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:46:28.313573 27492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.309776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:40347 (local address 127.27.186.65:48949)
0811 16:46:28.309853 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:28.309866 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:28.309913 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:28.310128 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:28.310129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:28.310131 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:28.310213 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.310215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.311145 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.311145 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.312402 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.312406 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.313197 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.313199 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.313279 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.313285 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 16:46:28.313350 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 16:46:28.313410 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":3}
I20260811 16:46:28.313581 27949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.309823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:39407 (local address 127.27.186.65:47019)
0811 16:46:28.310002 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:28.310014 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:28.310091 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:28.310294 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:28.310294 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:28.310296 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:28.310355 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.310356 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.311204 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.311204 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.312406 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:28.312407 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.313198 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.313199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:28.313290 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.313293 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:28.313350 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 16:46:28.313410 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":41,"thread_start_us":108,"threads_started":1}
I20260811 16:46:28.314002 27851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "515c000559fb456d9a8933f14d9580f1" candidate_uuid: "01ed660a636541758f9262159cf738ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" is_pre_election: true
I20260811 16:46:28.314091 27628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "515c000559fb456d9a8933f14d9580f1" candidate_uuid: "01ed660a636541758f9262159cf738ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2705c965988144d29965c85254445413" is_pre_election: true
I20260811 16:46:28.314204 27851 raft_consensus.cc:2454] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01ed660a636541758f9262159cf738ea in term 0.
I20260811 16:46:28.314289 27628 raft_consensus.cc:2454] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01ed660a636541758f9262159cf738ea in term 0.
I20260811 16:46:28.314479 27304 leader_election.cc:302] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01ed660a636541758f9262159cf738ea, ac11ffd2d96c45fcace837f70fcc76ac; no voters:
I20260811 16:46:28.314621 27948 raft_consensus.cc:2781] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260811 16:46:28.314664 27704 tablet.cc:2369] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:46:28.314699 27948 raft_consensus.cc:482] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:46:28.314733 27948 raft_consensus.cc:3037] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:28.315491 27948 raft_consensus.cc:504] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.315649 27948 leader_election.cc:288] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [CANDIDATE]: Term 1 election: Requested vote from peers ac11ffd2d96c45fcace837f70fcc76ac (127.27.186.67:40347), 2705c965988144d29965c85254445413 (127.27.186.66:39407)
I20260811 16:46:28.315794 27851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "515c000559fb456d9a8933f14d9580f1" candidate_uuid: "01ed660a636541758f9262159cf738ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac11ffd2d96c45fcace837f70fcc76ac"
I20260811 16:46:28.315805 27628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "515c000559fb456d9a8933f14d9580f1" candidate_uuid: "01ed660a636541758f9262159cf738ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2705c965988144d29965c85254445413"
I20260811 16:46:28.315886 27851 raft_consensus.cc:3037] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:28.315882 27628 raft_consensus.cc:3037] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:28.316635 27628 raft_consensus.cc:2454] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01ed660a636541758f9262159cf738ea in term 1.
I20260811 16:46:28.316658 27851 raft_consensus.cc:2454] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01ed660a636541758f9262159cf738ea in term 1.
I20260811 16:46:28.316819 27303 leader_election.cc:302] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01ed660a636541758f9262159cf738ea, 2705c965988144d29965c85254445413; no voters:
I20260811 16:46:28.316913 27948 raft_consensus.cc:2781] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:28.317113 27948 raft_consensus.cc:686] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 1 LEADER]: Becoming Leader. State: Replica: 01ed660a636541758f9262159cf738ea, State: Running, Role: LEADER
I20260811 16:46:28.317225 27948 consensus_queue.cc:237] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } }
I20260811 16:46:28.318125 27171 catalog_manager.cc:5495] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 01ed660a636541758f9262159cf738ea (127.27.186.65). New cstate: current_term: 1 leader_uuid: "01ed660a636541758f9262159cf738ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01ed660a636541758f9262159cf738ea" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 40163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20260811 16:46:28.345374 27933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.342841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34652 (local address 127.27.186.65:40163)
0811 16:46:28.342909 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:28.342911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:28.342920 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:46:28.342966 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:28.342967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:28.342997 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:28.343082 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:46:28.343236 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.343714 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.344498 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:28.344722 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:28.344801 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:28.344962 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:46:28.345072 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:46:28.345187 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:28.345242 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:46:28.345254 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:46:28.347469 27851 raft_consensus.cc:1261] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 1 FOLLOWER]: Refusing update from remote peer 01ed660a636541758f9262159cf738ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:28.347492 27628 raft_consensus.cc:1261] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 1 FOLLOWER]: Refusing update from remote peer 01ed660a636541758f9262159cf738ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:28.347882 27948 consensus_queue.cc:1035] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2705c965988144d29965c85254445413" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:28.348061 27956 consensus_queue.cc:1035] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac11ffd2d96c45fcace837f70fcc76ac" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:28.350520 27960 mvcc.cc:205] Tried to move back new op lower bound from 7317367965068255232 to 7317367964947959808. Current Snapshot: MvccSnapshot[applied={T|T < 7317367965068255232}]
I20260811 16:46:28.351040 27962 mvcc.cc:205] Tried to move back new op lower bound from 7317367965068255232 to 7317367964947959808. Current Snapshot: MvccSnapshot[applied={T|T < 7317367965068255232}]
I20260811 16:46:28.351177 27961 mvcc.cc:205] Tried to move back new op lower bound from 7317367965068255232 to 7317367964947959808. Current Snapshot: MvccSnapshot[applied={T|T < 7317367965068255232}]
I20260811 16:46:28.353659 27171 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:28.353766 27171 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:28.354610 27171 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 66dee15180eb4781b45ced5a903b7829: Sending DeleteTablet for 3 replicas of tablet 515c000559fb456d9a8933f14d9580f1
I20260811 16:46:28.354943 27811 tablet_service.cc:1514] Processing DeleteTablet for tablet 515c000559fb456d9a8933f14d9580f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:28 UTC) from {username='slave'} at 127.0.0.1:37196
I20260811 16:46:28.355095 27360 tablet_service.cc:1514] Processing DeleteTablet for tablet 515c000559fb456d9a8933f14d9580f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:28 UTC) from {username='slave'} at 127.0.0.1:34646
I20260811 16:46:28.355331 27977 tablet_replica.cc:330] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea: stopping tablet replica
I20260811 16:46:28.355335 27591 tablet_service.cc:1514] Processing DeleteTablet for tablet 515c000559fb456d9a8933f14d9580f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:28 UTC) from {username='slave'} at 127.0.0.1:40202
I20260811 16:46:28.355492 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 27269
I20260811 16:46:28.355518 27977 raft_consensus.cc:2229] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 1 LEADER]: Raft consensus shutting down.
I20260811 16:46:28.355713 27977 raft_consensus.cc:2258] T 515c000559fb456d9a8933f14d9580f1 P 01ed660a636541758f9262159cf738ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:28.358626 27978 tablet_replica.cc:330] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: stopping tablet replica
I20260811 16:46:28.358747 27978 raft_consensus.cc:2229] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:28.358881 27978 raft_consensus.cc:2258] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:28.359058 27976 tablet_replica.cc:330] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: stopping tablet replica
I20260811 16:46:28.359189 27976 raft_consensus.cc:2229] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:28.359316 27976 raft_consensus.cc:2258] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:28.363814 27976 ts_tablet_manager.cc:1905] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:28.366616 27976 ts_tablet_manager.cc:1918] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:28.366734 27976 log.cc:1196] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/515c000559fb456d9a8933f14d9580f1
I20260811 16:46:28.367079 27976 ts_tablet_manager.cc:1939] T 515c000559fb456d9a8933f14d9580f1 P ac11ffd2d96c45fcace837f70fcc76ac: Deleting consensus metadata
I20260811 16:46:28.367570 27147 catalog_manager.cc:4841] TS ac11ffd2d96c45fcace837f70fcc76ac (127.27.186.67:40347): tablet 515c000559fb456d9a8933f14d9580f1 (table test-table [id=c637ae4e0c6b43a79a2059919c32a83e]) successfully deleted
I20260811 16:46:28.367959 27978 ts_tablet_manager.cc:1905] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:28.369424 27978 ts_tablet_manager.cc:1918] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:28.369550 27978 log.cc:1196] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/515c000559fb456d9a8933f14d9580f1
I20260811 16:46:28.369854 27978 ts_tablet_manager.cc:1939] T 515c000559fb456d9a8933f14d9580f1 P 2705c965988144d29965c85254445413: Deleting consensus metadata
I20260811 16:46:28.370363 27145 catalog_manager.cc:4841] TS 2705c965988144d29965c85254445413 (127.27.186.66:39407): tablet 515c000559fb456d9a8933f14d9580f1 (table test-table [id=c637ae4e0c6b43a79a2059919c32a83e]) successfully deleted
W20260811 16:46:28.372192 27147 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:40163 (error 108)
I20260811 16:46:28.372469 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 27493
I20260811 16:46:28.372707 27928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:28.372577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:40163 (local address 127.0.0.1:34666)
0811 16:46:28.372630 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:28.372666 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:40163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 16:46:28.377528 27147 catalog_manager.cc:4584] TS 01ed660a636541758f9262159cf738ea (127.27.186.65:40163): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 515c000559fb456d9a8933f14d9580f1: Network error: Client connection negotiation failed: client connection to 127.27.186.65:40163: connect: Connection refused (error 111)
I20260811 16:46:28.382372 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 27706
I20260811 16:46:28.399537 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 27118
2026-08-11T16:46:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (827 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:28 dist-test-slave-gsp7 krb5kdc[27986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:28 dist-test-slave-gsp7 krb5kdc[27986](info): set up 2 sockets
Aug 11 16:46:28 dist-test-slave-gsp7 krb5kdc[27986](info): commencing operation
krb5kdc: starting...
W20260811 16:46:29.679064 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:29 dist-test-slave-gsp7 krb5kdc[27986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:29.812501 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:32857
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:32857
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:29.897377 28007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:29.897689 28007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:29.897738 28007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:29.899075 28007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:29.899148 28007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:29.899174 28007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:29.899199 28007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:29.899228 28007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:29.900908 28007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:32857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:32857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:29.901216 28007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:29.901497 28007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:46:29.907030 28007 server_base.cc:1034] running on GCE node
W20260811 16:46:29.906957 28017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:29.906957 28019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:29.906986 28016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:29.907490 28007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:29.907807 28007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:29.908973 28007 hybrid_clock.cc:648] HybridClock initialized: now 1786466789908940 us; error 67 us; skew 500 ppm
Aug 11 16:46:29 dist-test-slave-gsp7 krb5kdc[27986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466789, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:29.911579 28007 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:29.912173 28007 webserver.cc:460] Webserver started at http://127.27.186.126:34255/ using document root <none> and password file <none>
I20260811 16:46:29.912431 28007 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:29.912501 28007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:29.912659 28007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:29.913861 28007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "1f72eb2c8647442798964b1a437c1dab"
format_stamp: "Formatted at 2026-08-11 16:46:29 on dist-test-slave-gsp7"
server_key: "bfeb41f49576781df4b9563bbeaeaf16"
server_key_iv: "91eea5daf01c32fab540b67dbd88aaaa"
server_key_version: "encryptionkey@0"
I20260811 16:46:29.914240 28007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "1f72eb2c8647442798964b1a437c1dab"
format_stamp: "Formatted at 2026-08-11 16:46:29 on dist-test-slave-gsp7"
server_key: "bfeb41f49576781df4b9563bbeaeaf16"
server_key_iv: "91eea5daf01c32fab540b67dbd88aaaa"
server_key_version: "encryptionkey@0"
I20260811 16:46:29.915711 28007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:46:29.916512 28030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:29.916680 28007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:29.916790 28007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "1f72eb2c8647442798964b1a437c1dab"
format_stamp: "Formatted at 2026-08-11 16:46:29 on dist-test-slave-gsp7"
server_key: "bfeb41f49576781df4b9563bbeaeaf16"
server_key_iv: "91eea5daf01c32fab540b67dbd88aaaa"
server_key_version: "encryptionkey@0"
I20260811 16:46:29.916869 28007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:29.944819 28007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:29.946918 28007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:29.947095 28007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:29.951565 28007 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:32857
I20260811 16:46:29.951619 28112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:32857 every 8 connection(s)
I20260811 16:46:29.952000 28007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:29.952895 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:29.955330 28113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab: Bootstrap starting.
I20260811 16:46:29.955896 28113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:29.956163 28113 log.cc:824] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:29.956897 28113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab: No bootstrap required, opened a new log
I20260811 16:46:29.958747 28113 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f72eb2c8647442798964b1a437c1dab" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32857 } }
I20260811 16:46:29.958897 28113 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:29.958921 28113 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f72eb2c8647442798964b1a437c1dab, State: Initialized, Role: FOLLOWER
I20260811 16:46:29.958923 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28007
I20260811 16:46:29.959056 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:29.959080 28113 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f72eb2c8647442798964b1a437c1dab" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32857 } }
I20260811 16:46:29.959177 28113 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:29.959224 28113 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:29.959280 28113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:29.959285 28393 external_mini_cluster.cc:1428] Setting key 95c16bdebf5c5237de937c119484853c
I20260811 16:46:29.960054 28113 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f72eb2c8647442798964b1a437c1dab" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32857 } }
I20260811 16:46:29.960201 28113 leader_election.cc:302] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f72eb2c8647442798964b1a437c1dab; no voters:
I20260811 16:46:29.960403 28113 leader_election.cc:288] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:29.960425 28120 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:29.960542 28120 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [term 1 LEADER]: Becoming Leader. State: Replica: 1f72eb2c8647442798964b1a437c1dab, State: Running, Role: LEADER
I20260811 16:46:29.960690 28113 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:29.960695 28120 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f72eb2c8647442798964b1a437c1dab" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32857 } }
I20260811 16:46:29.961200 28123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f72eb2c8647442798964b1a437c1dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f72eb2c8647442798964b1a437c1dab" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32857 } } }
I20260811 16:46:29.961225 28121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f72eb2c8647442798964b1a437c1dab. Latest consensus state: current_term: 1 leader_uuid: "1f72eb2c8647442798964b1a437c1dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f72eb2c8647442798964b1a437c1dab" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32857 } } }
I20260811 16:46:29.961413 28121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:29.961695 28123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:29.961704 28133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:29.962466 28133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:29.964154 28133 catalog_manager.cc:1347] Generated new cluster ID: 476c475e2a0c49d9a8579f85f9fee650
I20260811 16:46:29.964213 28133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:46:29 dist-test-slave-gsp7 krb5kdc[27986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:29.972493 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:29.960125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58532 (local address 127.27.186.126:32857)
0811 16:46:29.960411 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:29.960420 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:29.960466 (+ 46us) server_negotiation.cc:407] Connection header received
0811 16:46:29.960605 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:29.960613 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:29.960667 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:29.961715 (+ 1048us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:29.961853 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:29.963202 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:29.964278 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:29.964899 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:29.965014 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:29.968185 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:29.968189 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:29.968190 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:29.968203 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:29.970252 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:29.970733 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:29.970737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:29.970737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:29.970890 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:29.971106 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:29.971107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:29.971107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:29.971432 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:29.971596 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:29.972080 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 16:46:29.972260 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":199,"threads_started":1}
I20260811 16:46:29.976657 28133 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:29.977394 28133 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:29.980870 28133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab: Generated new TSK 0
I20260811 16:46:29.981070 28133 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.27.186.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
Entry for principal kudu/127.27.186.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab.
I20260811 16:46:30.014372 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32857
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:30.100700 28159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:30.100917 28159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:30.100942 28159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:30.102144 28159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:30.102198 28159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:30.102226 28159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:46:30.103641 28159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.65.keytab
--principal=kudu/127.27.186.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:30.103833 28159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:30.104007 28159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 16:46:30.109112 28159 server_base.cc:1034] running on GCE node
W20260811 16:46:30.109081 28171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:30.109094 28169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:30.109122 28168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:30.109589 28159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:30.109791 28159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:30.110939 28159 hybrid_clock.cc:648] HybridClock initialized: now 1786466790110918 us; error 36 us; skew 500 ppm
Aug 11 16:46:30 dist-test-slave-gsp7 krb5kdc[27986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466790, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:30.113639 28159 init.cc:377] Logged in from keytab as kudu/127.27.186.65@KRBTEST.COM (short username kudu)
I20260811 16:46:30.114078 28159 webserver.cc:460] Webserver started at http://127.27.186.65:45543/ using document root <none> and password file <none>
I20260811 16:46:30.114305 28159 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:30.114349 28159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:30.114514 28159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:30.115585 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "e5a0cb6752954353b4adfdf1a8c8970b"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "39a18d9a2a1ee9a3fe88e819150cc975"
server_key_iv: "9466df2f2fd17ebbfebc49849b7bdfcf"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.115970 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "e5a0cb6752954353b4adfdf1a8c8970b"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "39a18d9a2a1ee9a3fe88e819150cc975"
server_key_iv: "9466df2f2fd17ebbfebc49849b7bdfcf"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.117336 28159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:30.118156 28184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.118342 28159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:30.118439 28159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "e5a0cb6752954353b4adfdf1a8c8970b"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "39a18d9a2a1ee9a3fe88e819150cc975"
server_key_iv: "9466df2f2fd17ebbfebc49849b7bdfcf"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.118513 28159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:30.144732 28159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:30.146888 28159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:30.147070 28159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:30.147336 28159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:30.147691 28159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:30.147754 28159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.147797 28159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:30.147826 28159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.154104 28159 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:41533
I20260811 16:46:30.154170 28366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:41533 every 8 connection(s)
I20260811 16:46:30.154512 28159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
Aug 11 16:46:30 dist-test-slave-gsp7 krb5kdc[27986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466790, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.65@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:30.161026 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28159
I20260811 16:46:30.161193 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:46:30.161402 28393 external_mini_cluster.cc:1428] Setting key 138ba7b00034c389d4a2c2333f26e35f
I20260811 16:46:30.164671 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.155302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:53635 (local address 127.27.186.126:32857)
0811 16:46:30.155352 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.155354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.155622 (+ 268us) server_negotiation.cc:407] Connection header received
0811 16:46:30.156186 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.156187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.156200 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.156259 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:30.157278 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.157856 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.158884 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.159092 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.159165 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.161605 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:30.161607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:30.161608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:30.161617 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:30.163101 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:30.163518 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:30.163520 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:30.163520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:30.163579 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:30.163879 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:30.163881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:30.163882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:30.164060 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:30.164142 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.164497 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.164600 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:46:30.164966 28371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.155256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:32857 (local address 127.27.186.65:53635)
0811 16:46:30.155493 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.155534 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.156081 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.156336 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.156341 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.156957 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:30.157161 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.157166 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.157962 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.157963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.158791 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.158794 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.159196 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.159197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.159322 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.159858 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:30.159866 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:30.161503 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:30.163199 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:30.163207 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:30.163209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:30.163444 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:30.163656 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:30.163657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:30.163657 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:30.163775 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:30.164139 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:30.164147 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:30.164333 (+ 186us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.164476 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.164686 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":109,"threads_started":1}
I20260811 16:46:30.165585 28367 heartbeater.cc:347] Connected to a master server at 127.27.186.126:32857
I20260811 16:46:30.165675 28367 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:30.165869 28367 heartbeater.cc:511] Master 127.27.186.126:32857 requested a full tablet report, sending...
I20260811 16:46:30.166435 28055 ts_manager.cc:194] Registered new tserver with Master: e5a0cb6752954353b4adfdf1a8c8970b (127.27.186.65:41533)
I20260811 16:46:30.167058 28055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.65@KRBTEST.COM'} at 127.27.186.65:53635
WARNING: no policy specified for kudu/127.27.186.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
Entry for principal kudu/127.27.186.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab.
I20260811 16:46:30.193713 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32857
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:30.279929 28376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:30.280187 28376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:30.280230 28376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:30.281453 28376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:30.281569 28376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:30.281638 28376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:46:30.283174 28376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.66.keytab
--principal=kudu/127.27.186.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:30.283433 28376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:30.283679 28376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:30.288986 28382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:30.289121 28376 server_base.cc:1034] running on GCE node
W20260811 16:46:30.288995 28383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:30.289049 28386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:30.289425 28376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:30.289734 28376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:30.290925 28376 hybrid_clock.cc:648] HybridClock initialized: now 1786466790290910 us; error 36 us; skew 500 ppm
Aug 11 16:46:30 dist-test-slave-gsp7 krb5kdc[27986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466790, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:30.293577 28376 init.cc:377] Logged in from keytab as kudu/127.27.186.66@KRBTEST.COM (short username kudu)
I20260811 16:46:30.294036 28376 webserver.cc:460] Webserver started at http://127.27.186.66:33241/ using document root <none> and password file <none>
I20260811 16:46:30.294276 28376 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:30.294344 28376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:30.294493 28376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:30.295624 28376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "c3d6ac16653a4aec9a14bdb696e215ba"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "5e395547bbcd8b25f57d403bdd3b6647"
server_key_iv: "4ea33f7cf033746656ab668b9dcc1748"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.296005 28376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "c3d6ac16653a4aec9a14bdb696e215ba"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "5e395547bbcd8b25f57d403bdd3b6647"
server_key_iv: "4ea33f7cf033746656ab668b9dcc1748"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.297542 28376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:46:30.298355 28404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.298547 28376 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:30.298653 28376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "c3d6ac16653a4aec9a14bdb696e215ba"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "5e395547bbcd8b25f57d403bdd3b6647"
server_key_iv: "4ea33f7cf033746656ab668b9dcc1748"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.298734 28376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:30.305693 28376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:30.307717 28376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:30.307893 28376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:30.308174 28376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:30.308504 28376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:30.308563 28376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.308600 28376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:30.308643 28376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.315258 28376 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:40679
I20260811 16:46:30.315338 28576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:40679 every 8 connection(s)
I20260811 16:46:30.315686 28376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:46:30.320477 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28376
I20260811 16:46:30.320623 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:46:30.320883 28393 external_mini_cluster.cc:1428] Setting key 74137f6d91e7a10fdf576a11f7114c6d
Aug 11 16:46:30 dist-test-slave-gsp7 krb5kdc[27986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466790, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.66@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:30.326637 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.316513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:42461 (local address 127.27.186.126:32857)
0811 16:46:30.316562 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.316569 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.316747 (+ 178us) server_negotiation.cc:407] Connection header received
0811 16:46:30.317281 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.317282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.317292 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.317360 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:30.318425 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.318935 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.320071 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.320332 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.320396 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.323287 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:30.323289 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:30.323289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:30.323296 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:30.324998 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:30.325404 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:30.325405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:30.325406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:30.325473 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:30.325885 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:30.325886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:30.325887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:30.326048 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:30.326120 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.326397 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.326505 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:46:30.326733 28579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.316429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:32857 (local address 127.27.186.66:42461)
0811 16:46:30.316611 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.316657 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.317194 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.317442 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.317445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.318107 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:30.318312 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.318318 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.319032 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.319032 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.319972 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.319975 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.320429 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.320430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.320594 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.321259 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:30.321271 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:30.323192 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:30.325095 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:30.325102 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:30.325104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:30.325330 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:30.325603 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:30.325604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:30.325605 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:30.325796 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:30.326125 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:30.326131 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:30.326259 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.326345 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.326481 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
I20260811 16:46:30.327289 28577 heartbeater.cc:347] Connected to a master server at 127.27.186.126:32857
I20260811 16:46:30.327399 28577 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:30.327615 28577 heartbeater.cc:511] Master 127.27.186.126:32857 requested a full tablet report, sending...
I20260811 16:46:30.328058 28055 ts_manager.cc:194] Registered new tserver with Master: c3d6ac16653a4aec9a14bdb696e215ba (127.27.186.66:40679)
I20260811 16:46:30.328434 28055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.66@KRBTEST.COM'} at 127.27.186.66:42461
WARNING: no policy specified for kudu/127.27.186.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
Entry for principal kudu/127.27.186.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab.
I20260811 16:46:30.350620 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32857
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:30.435248 28584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:30.435484 28584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:30.435510 28584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:30.436905 28584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:30.436966 28584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:30.436995 28584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:46:30.438536 28584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.67.keytab
--principal=kudu/127.27.186.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:32857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:30.438781 28584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:30.439034 28584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:30.444479 28593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:30.444489 28595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:30.444564 28584 server_base.cc:1034] running on GCE node
W20260811 16:46:30.444489 28592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:30.444903 28584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:30.445156 28584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:30.446307 28584 hybrid_clock.cc:648] HybridClock initialized: now 1786466790446292 us; error 29 us; skew 500 ppm
Aug 11 16:46:30 dist-test-slave-gsp7 krb5kdc[27986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466790, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:30.448905 28584 init.cc:377] Logged in from keytab as kudu/127.27.186.67@KRBTEST.COM (short username kudu)
I20260811 16:46:30.449381 28584 webserver.cc:460] Webserver started at http://127.27.186.67:46757/ using document root <none> and password file <none>
I20260811 16:46:30.449633 28584 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:30.449681 28584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:30.449847 28584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:30.450950 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "589149c6e7c54c58b6274cf582eb847f"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "a4930d0836012d0fb42dd8099f9b3595"
server_key_iv: "d7c44eb51f4f29cbd4831f91407f74e7"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.451326 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "589149c6e7c54c58b6274cf582eb847f"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "a4930d0836012d0fb42dd8099f9b3595"
server_key_iv: "d7c44eb51f4f29cbd4831f91407f74e7"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.452793 28584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:30.453577 28610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.453763 28584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:30.453860 28584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "589149c6e7c54c58b6274cf582eb847f"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "a4930d0836012d0fb42dd8099f9b3595"
server_key_iv: "d7c44eb51f4f29cbd4831f91407f74e7"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.453930 28584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:30.465256 28584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:30.467540 28584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:30.467701 28584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:30.467944 28584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:30.468276 28584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:30.468330 28584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.468374 28584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:30.468400 28584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.474665 28584 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:39955
I20260811 16:46:30.474736 28803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:39955 every 8 connection(s)
I20260811 16:46:30.475077 28584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:46:30.476351 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28584
I20260811 16:46:30.476464 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:46:30.476651 28393 external_mini_cluster.cc:1428] Setting key 8eb927221c2b07259e07f223b5b11fbf
Aug 11 16:46:30 dist-test-slave-gsp7 krb5kdc[27986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466790, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.67@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:30.484644 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.475951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:50423 (local address 127.27.186.126:32857)
0811 16:46:30.476014 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.476016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.476232 (+ 216us) server_negotiation.cc:407] Connection header received
0811 16:46:30.476904 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.476906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.476921 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.476993 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:30.478079 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.478591 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.479617 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.479816 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.479909 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.482288 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:30.482290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:30.482290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:30.482297 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:30.483497 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:30.483863 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:30.483864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:30.483864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:30.483923 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:30.484131 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:30.484131 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:30.484132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:30.484232 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:30.484282 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.484515 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.484578 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:46:30.484869 28809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.475932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:32857 (local address 127.27.186.67:50423)
0811 16:46:30.476106 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.476144 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.476771 (+ 627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.477077 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.477081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.477764 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:30.477969 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.477975 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.478690 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.478691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.479518 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.479520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.479915 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.479917 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.480049 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.480527 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:46:30.480536 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:30.482207 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:30.483568 (+ 1361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:30.483575 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:30.483577 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:30.483799 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:30.483979 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:46:30.483980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:46:30.483980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:46:30.484078 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:46:30.484284 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:30.484289 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:30.484406 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.484491 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.484613 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260811 16:46:30.485430 28805 heartbeater.cc:347] Connected to a master server at 127.27.186.126:32857
I20260811 16:46:30.485560 28805 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:30.485724 28805 heartbeater.cc:511] Master 127.27.186.126:32857 requested a full tablet report, sending...
I20260811 16:46:30.486054 28055 ts_manager.cc:194] Registered new tserver with Master: 589149c6e7c54c58b6274cf582eb847f (127.27.186.67:39955)
I20260811 16:46:30.486395 28055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.27.186.67@KRBTEST.COM'} at 127.27.186.67:50423
I20260811 16:46:30.488217 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:46:30.495144 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.489545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58534 (local address 127.27.186.126:32857)
0811 16:46:30.489605 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.489607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.489708 (+ 101us) server_negotiation.cc:407] Connection header received
0811 16:46:30.489749 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.489750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.489758 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.489810 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:30.490319 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.490794 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.491461 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.491647 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.491696 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.492833 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:30.492834 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:30.492834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:30.492839 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:30.494054 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:30.494426 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:30.494427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:30.494428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:30.494484 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:30.494657 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:30.494658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:30.494658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:30.494818 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:30.494908 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.494979 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.495041 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 16:46:30.496785 28055 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:46:30.498559 28055 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:46:30.505200 28831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.500992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:41533 (local address 127.0.0.1:51140)
0811 16:46:30.501239 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.501252 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.501310 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.501623 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.501624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.501625 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:30.501665 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.501667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.503007 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.503008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.504193 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.504196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.504883 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.504884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.504964 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.504977 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.505055 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.505106 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":10,"thread_start_us":76,"threads_started":1}
I20260811 16:46:30.505309 28829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.500921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34882 (local address 127.27.186.66:40679)
0811 16:46:30.501438 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.501442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.501452 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:46:30.501552 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.501555 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.501572 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.501650 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:30.501874 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.502718 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.504286 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.504982 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.505051 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.505105 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.505179 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.505218 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":93,"threads_started":1}
I20260811 16:46:30.505414 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.500940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47646 (local address 127.27.186.67:39955)
0811 16:46:30.501268 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.501272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.501280 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:46:30.501312 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.501314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.501326 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.501417 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:30.501756 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.502912 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.504154 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.504860 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.504933 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.505001 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.505279 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.505327 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":87,"threads_started":1}
I20260811 16:46:30.505538 28825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.500778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:40679 (local address 127.0.0.1:34882)
0811 16:46:30.501110 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.501121 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.501162 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.501760 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.501761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.501763 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:30.501811 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.501813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.502822 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.502823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.504193 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.504196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.505052 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.505053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.505108 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.505111 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.505165 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.505197 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":41,"thread_start_us":106,"threads_started":1}
I20260811 16:46:30.505637 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.500751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:39955 (local address 127.0.0.1:47646)
0811 16:46:30.500952 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.500993 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.501064 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.501556 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.501559 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.501561 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:30.501631 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.501633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.503020 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.503021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.504057 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.504060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.505041 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.505043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.505117 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.505122 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.505174 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.505218 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":42,"thread_start_us":50,"threads_started":1}
I20260811 16:46:30.505719 28832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.501230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51140 (local address 127.27.186.65:41533)
0811 16:46:30.501437 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.501442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.501451 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:46:30.501506 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.501509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.501524 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.501744 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:30.501821 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.502876 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.504302 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.504793 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.504883 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.504945 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.505247 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.505300 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":100,"threads_started":1}
I20260811 16:46:30.506256 28476 tablet_service.cc:1467] Processing CreateTablet for tablet d95e6fa9c12a437a8a9a72fbc24a82fa (DEFAULT_TABLE table=test-table [id=42788ebb4cb349df974b2f27fc99ead2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:30.506352 28253 tablet_service.cc:1467] Processing CreateTablet for tablet d95e6fa9c12a437a8a9a72fbc24a82fa (DEFAULT_TABLE table=test-table [id=42788ebb4cb349df974b2f27fc99ead2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:30.506656 28253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d95e6fa9c12a437a8a9a72fbc24a82fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:30.506656 28476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d95e6fa9c12a437a8a9a72fbc24a82fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:30.510164 28837 tablet_bootstrap.cc:492] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Bootstrap starting.
I20260811 16:46:30.510795 28695 tablet_service.cc:1467] Processing CreateTablet for tablet d95e6fa9c12a437a8a9a72fbc24a82fa (DEFAULT_TABLE table=test-table [id=42788ebb4cb349df974b2f27fc99ead2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:30.511034 28837 tablet_bootstrap.cc:654] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:30.511226 28695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d95e6fa9c12a437a8a9a72fbc24a82fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:30.511682 28837 log.cc:824] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:30.512091 28833 tablet_bootstrap.cc:492] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b: Bootstrap starting.
I20260811 16:46:30.512594 28837 tablet_bootstrap.cc:492] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: No bootstrap required, opened a new log
I20260811 16:46:30.512681 28837 ts_tablet_manager.cc:1397] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:46:30.512763 28833 tablet_bootstrap.cc:654] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:30.513397 28833 log.cc:824] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:30.514307 28833 tablet_bootstrap.cc:492] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b: No bootstrap required, opened a new log
I20260811 16:46:30.514387 28833 ts_tablet_manager.cc:1397] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 16:46:30.514420 28837 raft_consensus.cc:348] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.514617 28837 raft_consensus.cc:374] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:30.514660 28837 raft_consensus.cc:729] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3d6ac16653a4aec9a14bdb696e215ba, State: Initialized, Role: FOLLOWER
I20260811 16:46:30.514775 28837 consensus_queue.cc:260] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.515091 28837 ts_tablet_manager.cc:1428] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:46:30.515219 28577 heartbeater.cc:503] Master 127.27.186.126:32857 was elected leader, sending a full tablet report...
I20260811 16:46:30.515404 28846 tablet_bootstrap.cc:492] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: Bootstrap starting.
I20260811 16:46:30.516120 28846 tablet_bootstrap.cc:654] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:30.516134 28833 raft_consensus.cc:348] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.516350 28833 raft_consensus.cc:374] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:30.516400 28833 raft_consensus.cc:729] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5a0cb6752954353b4adfdf1a8c8970b, State: Initialized, Role: FOLLOWER
I20260811 16:46:30.516525 28833 consensus_queue.cc:260] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.516721 28846 log.cc:824] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:30.516801 28833 ts_tablet_manager.cc:1428] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:46:30.516845 28367 heartbeater.cc:503] Master 127.27.186.126:32857 was elected leader, sending a full tablet report...
I20260811 16:46:30.517802 28846 tablet_bootstrap.cc:492] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: No bootstrap required, opened a new log
I20260811 16:46:30.517884 28846 ts_tablet_manager.cc:1397] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 16:46:30.519228 28846 raft_consensus.cc:348] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.519378 28846 raft_consensus.cc:374] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:30.519423 28846 raft_consensus.cc:729] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 589149c6e7c54c58b6274cf582eb847f, State: Initialized, Role: FOLLOWER
I20260811 16:46:30.519549 28846 consensus_queue.cc:260] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.519799 28846 ts_tablet_manager.cc:1428] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 16:46:30.519857 28805 heartbeater.cc:503] Master 127.27.186.126:32857 was elected leader, sending a full tablet report...
I20260811 16:46:30.550212 28852 raft_consensus.cc:482] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:30.550416 28852 raft_consensus.cc:504] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.550886 28852 leader_election.cc:288] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 589149c6e7c54c58b6274cf582eb847f (127.27.186.67:39955), c3d6ac16653a4aec9a14bdb696e215ba (127.27.186.66:40679)
I20260811 16:46:30.553766 28371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.551085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:40679 (local address 127.27.186.65:35127)
0811 16:46:30.551133 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.551147 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.551193 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.551348 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.551349 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.551351 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:30.551434 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.551436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.552111 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.552112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.552860 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.552861 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.553449 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.553450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.553570 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.553573 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.553650 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.553692 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 16:46:30.553766 28829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.551120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:35127 (local address 127.27.186.66:40679)
0811 16:46:30.551178 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.551180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.551192 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:46:30.551258 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.551259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.551266 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.551338 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:30.551516 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.552026 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.552965 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.553363 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.553450 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.553460 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.553661 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.553703 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 16:46:30.554066 28830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.551132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:52475 (local address 127.27.186.67:39955)
0811 16:46:30.551187 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.551189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.551522 (+ 333us) server_negotiation.cc:407] Connection header received
0811 16:46:30.551599 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.551600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.551610 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.551651 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:30.551811 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.552285 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.553210 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.553644 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.553727 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.553736 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.553919 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.553977 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:46:30.554193 28508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d95e6fa9c12a437a8a9a72fbc24a82fa" candidate_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" is_pre_election: true
I20260811 16:46:30.554296 28855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.551093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:39955 (local address 127.27.186.65:52475)
0811 16:46:30.551442 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.551451 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.551532 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.551663 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.551664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.551666 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:30.551742 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.551744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.552368 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.552369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.553115 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.553117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.553727 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.553728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.553803 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.553806 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.554173 (+ 367us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.554224 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":154,"thread_start_us":131,"threads_started":1}
I20260811 16:46:30.554375 28508 raft_consensus.cc:2454] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5a0cb6752954353b4adfdf1a8c8970b in term 0.
I20260811 16:46:30.554663 28188 leader_election.cc:302] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3d6ac16653a4aec9a14bdb696e215ba, e5a0cb6752954353b4adfdf1a8c8970b; no voters:
I20260811 16:46:30.554795 28852 raft_consensus.cc:2781] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:46:30.554786 28727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d95e6fa9c12a437a8a9a72fbc24a82fa" candidate_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "589149c6e7c54c58b6274cf582eb847f" is_pre_election: true
I20260811 16:46:30.554854 28852 raft_consensus.cc:482] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:46:30.554898 28852 raft_consensus.cc:3037] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:30.554957 28727 raft_consensus.cc:2454] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5a0cb6752954353b4adfdf1a8c8970b in term 0.
I20260811 16:46:30.555714 28852 raft_consensus.cc:504] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.555857 28852 leader_election.cc:288] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [CANDIDATE]: Term 1 election: Requested vote from peers 589149c6e7c54c58b6274cf582eb847f (127.27.186.67:39955), c3d6ac16653a4aec9a14bdb696e215ba (127.27.186.66:40679)
I20260811 16:46:30.556016 28727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d95e6fa9c12a437a8a9a72fbc24a82fa" candidate_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "589149c6e7c54c58b6274cf582eb847f"
I20260811 16:46:30.556107 28508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d95e6fa9c12a437a8a9a72fbc24a82fa" candidate_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3d6ac16653a4aec9a14bdb696e215ba"
I20260811 16:46:30.556109 28727 raft_consensus.cc:3037] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:30.556198 28508 raft_consensus.cc:3037] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:30.556917 28727 raft_consensus.cc:2454] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5a0cb6752954353b4adfdf1a8c8970b in term 1.
I20260811 16:46:30.557142 28508 raft_consensus.cc:2454] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5a0cb6752954353b4adfdf1a8c8970b in term 1.
I20260811 16:46:30.557178 28190 leader_election.cc:302] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 589149c6e7c54c58b6274cf582eb847f, e5a0cb6752954353b4adfdf1a8c8970b; no voters:
I20260811 16:46:30.557293 28852 raft_consensus.cc:2781] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:30.557552 28852 raft_consensus.cc:686] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [term 1 LEADER]: Becoming Leader. State: Replica: e5a0cb6752954353b4adfdf1a8c8970b, State: Running, Role: LEADER
I20260811 16:46:30.557693 28852 consensus_queue.cc:237] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } }
I20260811 16:46:30.558800 28055 catalog_manager.cc:5495] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b reported cstate change: term changed from 0 to 1, leader changed from <none> to e5a0cb6752954353b4adfdf1a8c8970b (127.27.186.65). New cstate: current_term: 1 leader_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5a0cb6752954353b4adfdf1a8c8970b" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 41533 } health_report { overall_health: HEALTHY } } }
W20260811 16:46:30.566300 28578 tablet.cc:2369] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:46:30.566988 28832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.564582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.27.186.65:41533)
0811 16:46:30.564638 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.564640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.564648 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:46:30.564721 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.564721 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.564738 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.564801 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:46:30.564912 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.565389 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.566174 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.566442 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.566517 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.566647 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:46:30.566742 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:46:30.566806 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.566845 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.566864 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 16:46:30.568859 28727 raft_consensus.cc:1261] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 1 FOLLOWER]: Refusing update from remote peer e5a0cb6752954353b4adfdf1a8c8970b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:30.568918 28508 raft_consensus.cc:1261] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 1 FOLLOWER]: Refusing update from remote peer e5a0cb6752954353b4adfdf1a8c8970b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:30.569236 28852 consensus_queue.cc:1035] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [LEADER]: Connected to new peer: Peer: permanent_uuid: "589149c6e7c54c58b6274cf582eb847f" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 39955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:30.569404 28856 consensus_queue.cc:1035] T d95e6fa9c12a437a8a9a72fbc24a82fa P e5a0cb6752954353b4adfdf1a8c8970b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3d6ac16653a4aec9a14bdb696e215ba" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:30.571828 28859 mvcc.cc:205] Tried to move back new op lower bound from 7317367974166917120 to 7317367974125019136. Current Snapshot: MvccSnapshot[applied={T|T < 7317367974166917120}]
I20260811 16:46:30.572471 28860 mvcc.cc:205] Tried to move back new op lower bound from 7317367974166917120 to 7317367974125019136. Current Snapshot: MvccSnapshot[applied={T|T < 7317367974166917120 or (T in {7317367974166917120})}]
I20260811 16:46:30.572600 28861 mvcc.cc:205] Tried to move back new op lower bound from 7317367974166917120 to 7317367974125019136. Current Snapshot: MvccSnapshot[applied={T|T < 7317367974166917120}]
I20260811 16:46:30.574246 28055 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:30.574352 28055 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:30.575081 28055 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f72eb2c8647442798964b1a437c1dab: Sending DeleteTablet for 3 replicas of tablet d95e6fa9c12a437a8a9a72fbc24a82fa
I20260811 16:46:30.575469 28695 tablet_service.cc:1514] Processing DeleteTablet for tablet d95e6fa9c12a437a8a9a72fbc24a82fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:30 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:47646
I20260811 16:46:30.575481 28476 tablet_service.cc:1514] Processing DeleteTablet for tablet d95e6fa9c12a437a8a9a72fbc24a82fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:30 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:34882
I20260811 16:46:30.575546 28253 tablet_service.cc:1514] Processing DeleteTablet for tablet d95e6fa9c12a437a8a9a72fbc24a82fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:30 UTC) from {username='kudu', principal='kudu/127.27.186.126@KRBTEST.COM'} at 127.0.0.1:51140
I20260811 16:46:30.575740 28871 tablet_replica.cc:330] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: stopping tablet replica
I20260811 16:46:30.575882 28873 tablet_replica.cc:330] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: stopping tablet replica
I20260811 16:46:30.575973 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28159
I20260811 16:46:30.576241 28871 raft_consensus.cc:2229] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:30.576610 28873 raft_consensus.cc:2229] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:30.576735 28873 raft_consensus.cc:2258] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:30.576906 28871 raft_consensus.cc:2258] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:30.579404 28873 ts_tablet_manager.cc:1905] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:30.581729 28873 ts_tablet_manager.cc:1918] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:30.581820 28873 log.cc:1196] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/d95e6fa9c12a437a8a9a72fbc24a82fa
I20260811 16:46:30.582214 28873 ts_tablet_manager.cc:1939] T d95e6fa9c12a437a8a9a72fbc24a82fa P 589149c6e7c54c58b6274cf582eb847f: Deleting consensus metadata
I20260811 16:46:30.583928 28036 catalog_manager.cc:4841] TS 589149c6e7c54c58b6274cf582eb847f (127.27.186.67:39955): tablet d95e6fa9c12a437a8a9a72fbc24a82fa (table test-table [id=42788ebb4cb349df974b2f27fc99ead2]) successfully deleted
I20260811 16:46:30.584029 28871 ts_tablet_manager.cc:1905] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:30.585429 28871 ts_tablet_manager.cc:1918] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:30.585567 28871 log.cc:1196] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/d95e6fa9c12a437a8a9a72fbc24a82fa
I20260811 16:46:30.585824 28871 ts_tablet_manager.cc:1939] T d95e6fa9c12a437a8a9a72fbc24a82fa P c3d6ac16653a4aec9a14bdb696e215ba: Deleting consensus metadata
I20260811 16:46:30.586258 28035 catalog_manager.cc:4841] TS c3d6ac16653a4aec9a14bdb696e215ba (127.27.186.66:40679): tablet d95e6fa9c12a437a8a9a72fbc24a82fa (table test-table [id=42788ebb4cb349df974b2f27fc99ead2]) successfully deleted
W20260811 16:46:30.592157 28035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:41533 (error 108)
I20260811 16:46:30.592391 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28376
I20260811 16:46:30.596678 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.596523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:41533 (local address 127.0.0.1:51158)
0811 16:46:30.596580 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.596633 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:41533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260811 16:46:30.596913 28035 catalog_manager.cc:4584] TS e5a0cb6752954353b4adfdf1a8c8970b (127.27.186.65:41533): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d95e6fa9c12a437a8a9a72fbc24a82fa: Network error: Client connection negotiation failed: client connection to 127.27.186.65:41533: connect: Connection refused (error 111)
I20260811 16:46:30.600934 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28584
I20260811 16:46:30.614604 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28007
2026-08-11T16:46:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2214 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T16:46:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:30Z Disabled control of system clock
I20260811 16:46:30.649076 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34287
--webserver_interface=127.27.186.126
--webserver_port=0
--builtin_ntp_servers=127.27.186.84:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:34287
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:30.735703 28881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:30.735930 28881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:30.735954 28881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:30.737164 28881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:30.737210 28881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:30.737222 28881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:30.737234 28881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:30.737246 28881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:30.738713 28881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:34287
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:30.738973 28881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:30.739315 28881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:30.744227 28895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:30.744266 28897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:30.744424 28881 server_base.cc:1034] running on GCE node
W20260811 16:46:30.744262 28894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:30.744748 28881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:30.745069 28881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:30.746234 28881 hybrid_clock.cc:648] HybridClock initialized: now 1786466790746220 us; error 42 us; skew 500 ppm
I20260811 16:46:30.747609 28881 webserver.cc:460] Webserver started at http://127.27.186.126:45031/ using document root <none> and password file <none>
I20260811 16:46:30.747886 28881 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:30.747959 28881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:30.748121 28881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:30.749274 28881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "48647dbe8e3d4e72bb2d048989184c2f"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "abc4d992a7c4d0bf16ced56fa0f042ca"
server_key_iv: "69b0c2fe9910c1deb23e3be932c1f032"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.749665 28881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "48647dbe8e3d4e72bb2d048989184c2f"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "abc4d992a7c4d0bf16ced56fa0f042ca"
server_key_iv: "69b0c2fe9910c1deb23e3be932c1f032"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.751036 28881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:30.751792 28904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.752020 28881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:30.752177 28881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "48647dbe8e3d4e72bb2d048989184c2f"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "abc4d992a7c4d0bf16ced56fa0f042ca"
server_key_iv: "69b0c2fe9910c1deb23e3be932c1f032"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.752259 28881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:30.769902 28881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:30.770298 28881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:30.770462 28881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:30.774649 28881 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:34287
I20260811 16:46:30.774688 28981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:34287 every 8 connection(s)
I20260811 16:46:30.775060 28881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:30.776225 28982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:30.778651 28982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f: Bootstrap starting.
I20260811 16:46:30.779254 28982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:30.779577 28982 log.cc:824] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:30.780393 28982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f: No bootstrap required, opened a new log
I20260811 16:46:30.782416 28982 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48647dbe8e3d4e72bb2d048989184c2f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34287 } }
I20260811 16:46:30.782693 28982 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:30.782786 28982 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48647dbe8e3d4e72bb2d048989184c2f, State: Initialized, Role: FOLLOWER
I20260811 16:46:30.782984 28982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48647dbe8e3d4e72bb2d048989184c2f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34287 } }
I20260811 16:46:30.783064 28982 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:30.783123 28982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:30.783186 28982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:30.783840 28982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48647dbe8e3d4e72bb2d048989184c2f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34287 } }
I20260811 16:46:30.784019 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 28881
I20260811 16:46:30.784031 28982 leader_election.cc:302] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48647dbe8e3d4e72bb2d048989184c2f; no voters:
I20260811 16:46:30.784143 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:30.784240 28982 leader_election.cc:288] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:30.784297 28987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:30.784425 28393 external_mini_cluster.cc:1428] Setting key 81eef3b88deefa953ce4ff458ada68e0
I20260811 16:46:30.784509 28987 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [term 1 LEADER]: Becoming Leader. State: Replica: 48647dbe8e3d4e72bb2d048989184c2f, State: Running, Role: LEADER
I20260811 16:46:30.784564 28982 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:30.784615 28987 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48647dbe8e3d4e72bb2d048989184c2f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34287 } }
I20260811 16:46:30.784978 28987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48647dbe8e3d4e72bb2d048989184c2f. Latest consensus state: current_term: 1 leader_uuid: "48647dbe8e3d4e72bb2d048989184c2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48647dbe8e3d4e72bb2d048989184c2f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34287 } } }
I20260811 16:46:30.785065 28987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:30.785243 28988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48647dbe8e3d4e72bb2d048989184c2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48647dbe8e3d4e72bb2d048989184c2f" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34287 } } }
I20260811 16:46:30.785343 28988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:30.785529 28999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:30.786164 28999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:30.791368 28999 catalog_manager.cc:1347] Generated new cluster ID: 72c350d0e3c1482a80fac407315697de
I20260811 16:46:30.791469 28999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:30.792364 28996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.784972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33882 (local address 127.27.186.126:34287)
0811 16:46:30.786016 (+ 1044us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.786027 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.786656 (+ 629us) server_negotiation.cc:407] Connection header received
0811 16:46:30.786967 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.786973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.787036 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.787149 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:30.787481 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.788422 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.789710 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.790329 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.790508 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.791445 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:30.791450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:30.791451 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:30.791715 (+ 264us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:30.791792 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:30.791809 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:30.791890 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.792024 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.792114 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":958,"thread_start_us":78,"threads_started":1}
I20260811 16:46:30.815270 28999 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:30.816056 28999 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:30.823906 28999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f: Generated new TSK 0
I20260811 16:46:30.824132 28999 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:30.835151 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.65:0
--local_ip_for_outbound_sockets=127.27.186.65
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34287
--builtin_ntp_servers=127.27.186.84:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:30.928435 29028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:30.928655 29028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:30.928678 29028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:30.929911 29028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:30.929957 29028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:30.929982 29028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.65
I20260811 16:46:30.931413 29028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.186.65
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.65
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:30.931684 29028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:30.932024 29028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:30.937359 29036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:30.937373 29043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:30.937462 29037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:30.938092 29028 server_base.cc:1034] running on GCE node
I20260811 16:46:30.938381 29028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:30.938706 29028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:30.939873 29028 hybrid_clock.cc:648] HybridClock initialized: now 1786466790939856 us; error 35 us; skew 500 ppm
I20260811 16:46:30.941195 29028 webserver.cc:460] Webserver started at http://127.27.186.65:35079/ using document root <none> and password file <none>
I20260811 16:46:30.941521 29028 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:30.941591 29028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:30.941746 29028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:30.942837 29028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/data/instance:
uuid: "894cbc4645d44d8eb9b03438457463a7"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "311fd240fb921431b874a42bd49b2c9f"
server_key_iv: "56c13f00ede1509fdf83724232a9fa04"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.943205 29028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance:
uuid: "894cbc4645d44d8eb9b03438457463a7"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "311fd240fb921431b874a42bd49b2c9f"
server_key_iv: "56c13f00ede1509fdf83724232a9fa04"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.944576 29028 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:30.945370 29054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.945585 29028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:30.945688 29028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/wal
uuid: "894cbc4645d44d8eb9b03438457463a7"
format_stamp: "Formatted at 2026-08-11 16:46:30 on dist-test-slave-gsp7"
server_key: "311fd240fb921431b874a42bd49b2c9f"
server_key_iv: "56c13f00ede1509fdf83724232a9fa04"
server_key_version: "encryptionkey@0"
I20260811 16:46:30.945767 29028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:30.969204 29028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:30.969615 29028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:30.969779 29028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:30.970043 29028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:30.970410 29028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:30.970463 29028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.970498 29028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:30.970527 29028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:30.976632 29028 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.65:43795
I20260811 16:46:30.976711 29229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.65:43795 every 8 connection(s)
I20260811 16:46:30.977070 29028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/data/info.pb
I20260811 16:46:30.982744 28996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.977914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:37651 (local address 127.27.186.126:34287)
0811 16:46:30.977984 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:30.977987 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:30.978237 (+ 250us) server_negotiation.cc:407] Connection header received
0811 16:46:30.978801 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:30.978802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:30.978831 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:30.978883 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:30.979596 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.980123 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.981127 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.981355 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.981440 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.982412 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:30.982413 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:30.982413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:30.982419 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:30.982434 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:30.982439 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:30.982504 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:30.982631 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 16:46:30.982662 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 16:46:30.983179 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29028
I20260811 16:46:30.983289 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-0/wal/instance
I20260811 16:46:30.983510 28393 external_mini_cluster.cc:1428] Setting key 1b35f86ad1b83e1b925e8e01feb106b5
I20260811 16:46:30.983686 29238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:30.977889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34287 (local address 127.27.186.65:37651)
0811 16:46:30.978111 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:30.978146 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:30.978676 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:30.978960 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:30.978963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:30.978971 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:30.979486 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.979491 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.980223 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.980225 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.981026 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:30.981028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:30.981454 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:30.981455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:30.981610 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:30.982235 (+ 625us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:30.982235 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:30.982265 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:30.982298 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:30.982527 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:30.982542 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:30.982545 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:30.982612 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 16:46:30.982723 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":104,"threads_started":1}
I20260811 16:46:30.984391 29231 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34287
I20260811 16:46:30.984504 29231 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:30.984740 29231 heartbeater.cc:511] Master 127.27.186.126:34287 requested a full tablet report, sending...
I20260811 16:46:30.984759 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.66:0
--local_ip_for_outbound_sockets=127.27.186.66
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34287
--builtin_ntp_servers=127.27.186.84:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 16:46:30.985307 28938 ts_manager.cc:194] Registered new tserver with Master: 894cbc4645d44d8eb9b03438457463a7 (127.27.186.65:43795)
I20260811 16:46:30.986086 28938 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.65:37651
W20260811 16:46:31.070829 29239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:31.071053 29239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:31.071075 29239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:31.072247 29239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:31.072288 29239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:31.072314 29239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.66
I20260811 16:46:31.073673 29239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.186.66
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.66
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:31.073880 29239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:31.074151 29239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:31.079504 29252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:31.079499 29248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:31.079540 29249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:31.079936 29239 server_base.cc:1034] running on GCE node
I20260811 16:46:31.080129 29239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:31.080329 29239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:31.081523 29239 hybrid_clock.cc:648] HybridClock initialized: now 1786466791081450 us; error 40 us; skew 500 ppm
I20260811 16:46:31.082723 29239 webserver.cc:460] Webserver started at http://127.27.186.66:40949/ using document root <none> and password file <none>
I20260811 16:46:31.082939 29239 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:31.082981 29239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:31.083071 29239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:31.084208 29239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/data/instance:
uuid: "3c149a8697924f2190b8fabbd8ad7eed"
format_stamp: "Formatted at 2026-08-11 16:46:31 on dist-test-slave-gsp7"
server_key: "44deac26583635d94b1e28d2a9f6145c"
server_key_iv: "ef577a7ce517b92b95823e82d764f387"
server_key_version: "encryptionkey@0"
I20260811 16:46:31.084630 29239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance:
uuid: "3c149a8697924f2190b8fabbd8ad7eed"
format_stamp: "Formatted at 2026-08-11 16:46:31 on dist-test-slave-gsp7"
server_key: "44deac26583635d94b1e28d2a9f6145c"
server_key_iv: "ef577a7ce517b92b95823e82d764f387"
server_key_version: "encryptionkey@0"
I20260811 16:46:31.086112 29239 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:31.086848 29261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:31.087033 29239 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:31.087153 29239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/wal
uuid: "3c149a8697924f2190b8fabbd8ad7eed"
format_stamp: "Formatted at 2026-08-11 16:46:31 on dist-test-slave-gsp7"
server_key: "44deac26583635d94b1e28d2a9f6145c"
server_key_iv: "ef577a7ce517b92b95823e82d764f387"
server_key_version: "encryptionkey@0"
I20260811 16:46:31.087244 29239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:31.106881 29239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:31.107239 29239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:31.107398 29239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:31.107630 29239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:31.107968 29239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:31.108023 29239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:31.108067 29239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:31.108095 29239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:31.114442 29239 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.66:35565
I20260811 16:46:31.114557 29449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.66:35565 every 8 connection(s)
I20260811 16:46:31.114862 29239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/data/info.pb
I20260811 16:46:31.120820 28996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.115644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.66:42753 (local address 127.27.186.126:34287)
0811 16:46:31.115732 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.115736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.115962 (+ 226us) server_negotiation.cc:407] Connection header received
0811 16:46:31.116465 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.116467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.116479 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.116549 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:31.117231 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.117822 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.119310 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.119527 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.119599 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.120540 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:31.120541 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:31.120541 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:31.120547 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:31.120562 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:31.120566 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:31.120616 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.120701 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.120738 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 16:46:31.121052 29453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.115605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34287 (local address 127.27.186.66:42753)
0811 16:46:31.115811 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:31.115848 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:31.116354 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:31.116622 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:31.116625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:31.116633 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:31.117133 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.117138 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.117948 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.117949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.119210 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.119213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.119632 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.119634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.119776 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.120373 (+ 597us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:31.120373 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:31.120402 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:31.120433 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:31.120623 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:31.120628 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:31.120631 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:31.120703 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 16:46:31.120807 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":106,"threads_started":1}
I20260811 16:46:31.121382 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29239
I20260811 16:46:31.121531 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/wal/instance
I20260811 16:46:31.121541 29451 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34287
I20260811 16:46:31.121632 29451 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:31.121770 28393 external_mini_cluster.cc:1428] Setting key 6ef4860c721c1ff3613402f883dc3e76
I20260811 16:46:31.121843 29451 heartbeater.cc:511] Master 127.27.186.126:34287 requested a full tablet report, sending...
I20260811 16:46:31.122238 28937 ts_manager.cc:194] Registered new tserver with Master: 3c149a8697924f2190b8fabbd8ad7eed (127.27.186.66:35565)
I20260811 16:46:31.122728 28937 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.66:42753
I20260811 16:46:31.122889 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.186.67:0
--local_ip_for_outbound_sockets=127.27.186.67
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34287
--builtin_ntp_servers=127.27.186.84:41919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 16:46:31.209911 29456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:31.210168 29456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:31.210192 29456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:31.211381 29456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:31.211426 29456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:31.211455 29456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.186.67
I20260811 16:46:31.212868 29456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.186.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.186.67
--webserver_port=0
--tserver_master_addrs=127.27.186.126:34287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.186.67
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:31.213135 29456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:31.213459 29456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:31.218822 29465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:31.218873 29456 server_base.cc:1034] running on GCE node
W20260811 16:46:31.218883 29464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:31.218822 29468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:31.219341 29456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:31.219635 29456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:31.220794 29456 hybrid_clock.cc:648] HybridClock initialized: now 1786466791220784 us; error 30 us; skew 500 ppm
I20260811 16:46:31.222221 29456 webserver.cc:460] Webserver started at http://127.27.186.67:44947/ using document root <none> and password file <none>
I20260811 16:46:31.222515 29456 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:31.222568 29456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:31.222744 29456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:31.223866 29456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/data/instance:
uuid: "b6917d1ba8694d20a50f23fd6e6d0db5"
format_stamp: "Formatted at 2026-08-11 16:46:31 on dist-test-slave-gsp7"
server_key: "992e096c3e64c0469fd6a85e0946f238"
server_key_iv: "5f02e36787c56014c158654c30d97ea3"
server_key_version: "encryptionkey@0"
I20260811 16:46:31.224263 29456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance:
uuid: "b6917d1ba8694d20a50f23fd6e6d0db5"
format_stamp: "Formatted at 2026-08-11 16:46:31 on dist-test-slave-gsp7"
server_key: "992e096c3e64c0469fd6a85e0946f238"
server_key_iv: "5f02e36787c56014c158654c30d97ea3"
server_key_version: "encryptionkey@0"
I20260811 16:46:31.225749 29456 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:31.226490 29479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:31.226670 29456 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:31.226752 29456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/wal
uuid: "b6917d1ba8694d20a50f23fd6e6d0db5"
format_stamp: "Formatted at 2026-08-11 16:46:31 on dist-test-slave-gsp7"
server_key: "992e096c3e64c0469fd6a85e0946f238"
server_key_iv: "5f02e36787c56014c158654c30d97ea3"
server_key_version: "encryptionkey@0"
I20260811 16:46:31.226825 29456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:31.281294 29456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:31.281697 29456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:31.281862 29456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:31.282127 29456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 16:46:31.282487 29456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 16:46:31.282523 29456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:31.282548 29456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 16:46:31.282589 29456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:31.289232 29456 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.67:32943
I20260811 16:46:31.289258 29653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.67:32943 every 8 connection(s)
I20260811 16:46:31.289718 29456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/data/info.pb
I20260811 16:46:31.295166 28996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.290531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.67:52023 (local address 127.27.186.126:34287)
0811 16:46:31.290581 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.290583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.290832 (+ 249us) server_negotiation.cc:407] Connection header received
0811 16:46:31.291415 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.291416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.291427 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.291501 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:31.292191 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.292832 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.293906 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.294101 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.294155 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.294939 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:31.294940 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:31.294941 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:31.294946 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:31.294961 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:31.294965 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:31.295007 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.295073 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.295101 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:46:31.295360 29660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.290528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:34287 (local address 127.27.186.67:52023)
0811 16:46:31.290707 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:31.290743 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:31.291322 (+ 579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:31.291565 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:31.291568 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:31.291577 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:46:31.292100 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.292105 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.292925 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.292926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.293813 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.293816 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.294175 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.294176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.294288 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.294809 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 16:46:31.294809 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:46:31.294839 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 16:46:31.294862 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:46:31.295008 (+ 146us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:46:31.295011 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:46:31.295013 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 16:46:31.295064 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 16:46:31.295142 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260811 16:46:31.295907 29656 heartbeater.cc:347] Connected to a master server at 127.27.186.126:34287
I20260811 16:46:31.296015 29656 heartbeater.cc:464] Registering TS with master...
I20260811 16:46:31.296208 29656 heartbeater.cc:511] Master 127.27.186.126:34287 requested a full tablet report, sending...
I20260811 16:46:31.296607 28937 ts_manager.cc:194] Registered new tserver with Master: b6917d1ba8694d20a50f23fd6e6d0db5 (127.27.186.67:32943)
I20260811 16:46:31.296944 28937 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.27.186.67:52023
I20260811 16:46:31.299515 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29456
I20260811 16:46:31.299597 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/wal/instance
I20260811 16:46:31.299731 28393 external_mini_cluster.cc:1428] Setting key b3042346144eea6cb5fc8274236cd812
I20260811 16:46:31.300603 28393 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 16:46:31.304884 28996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.302122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33894 (local address 127.27.186.126:34287)
0811 16:46:31.302197 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.302199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.302336 (+ 137us) server_negotiation.cc:407] Connection header received
0811 16:46:31.302358 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.302359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.302372 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.302436 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:31.302569 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.303039 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.303786 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.303995 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.304053 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.304675 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:31.304676 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:31.304676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:31.304680 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:31.304693 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:31.304697 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:31.304740 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.304799 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.304824 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 16:46:31.306723 28937 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33894:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 16:46:31.308318 28937 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 16:46:31.314949 29671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.310531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:32943 (local address 127.0.0.1:57178)
0811 16:46:31.310865 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:31.310909 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:31.310988 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:31.311422 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:31.311425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:31.311427 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:31.311494 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.311495 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.312380 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.312381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.313540 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.313543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.314589 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.314590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.314706 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.314722 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 16:46:31.314795 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 16:46:31.314857 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":4,"thread_start_us":62,"threads_started":1}
I20260811 16:46:31.314980 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.310731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57178 (local address 127.27.186.67:32943)
0811 16:46:31.310902 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.310905 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.310968 (+ 63us) server_negotiation.cc:407] Connection header received
0811 16:46:31.311232 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.311235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.311252 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.311332 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:31.311572 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.312289 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.313615 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.314378 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.314451 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.314551 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.314831 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.314888 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
I20260811 16:46:31.315035 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.310628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52058 (local address 127.27.186.66:35565)
0811 16:46:31.310883 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.310888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.311252 (+ 364us) server_negotiation.cc:407] Connection header received
0811 16:46:31.311302 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.311304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.311318 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.311386 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:31.311609 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.312744 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.314022 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.314510 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.314601 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.314697 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.314899 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.314944 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":121,"threads_started":1}
I20260811 16:46:31.315205 29670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.310541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:35565 (local address 127.0.0.1:52058)
0811 16:46:31.311121 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:31.311131 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:31.311182 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:31.311455 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:31.311456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:31.311459 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:31.311520 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.311523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.312834 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.312835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.313936 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.313943 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.314605 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.314606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.314704 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.314725 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 16:46:31.314808 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 16:46:31.314858 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":40,"thread_start_us":56,"threads_started":1}
I20260811 16:46:31.315928 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.310745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:43795 (local address 127.0.0.1:42502)
0811 16:46:31.311123 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:31.311133 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:31.311182 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:31.311455 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:31.311456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:31.311461 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:31.311538 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.311539 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.313545 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.313546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.314622 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.314624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.315703 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.315704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.315766 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.315770 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:46:31.315824 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 16:46:31.315863 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":2,"thread_start_us":60,"threads_started":1}
I20260811 16:46:31.316172 29679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.310935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42502 (local address 127.27.186.65:43795)
0811 16:46:31.311135 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.311138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.311242 (+ 104us) server_negotiation.cc:407] Connection header received
0811 16:46:31.311293 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.311296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.311311 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.311386 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:31.311619 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.312744 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.314715 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.315484 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.315557 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.315662 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.316049 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.316091 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":102,"threads_started":1}
I20260811 16:46:31.316212 29556 tablet_service.cc:1467] Processing CreateTablet for tablet 2756479e6ccb4e81be9ec94aebca32d4 (DEFAULT_TABLE table=test-table [id=fd2acbf5137e4e3dacf1175da3cdeeba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:31.316205 29352 tablet_service.cc:1467] Processing CreateTablet for tablet 2756479e6ccb4e81be9ec94aebca32d4 (DEFAULT_TABLE table=test-table [id=fd2acbf5137e4e3dacf1175da3cdeeba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:31.316597 29352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2756479e6ccb4e81be9ec94aebca32d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:31.316608 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2756479e6ccb4e81be9ec94aebca32d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:31.316811 29129 tablet_service.cc:1467] Processing CreateTablet for tablet 2756479e6ccb4e81be9ec94aebca32d4 (DEFAULT_TABLE table=test-table [id=fd2acbf5137e4e3dacf1175da3cdeeba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 16:46:31.317123 29129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2756479e6ccb4e81be9ec94aebca32d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:31.319546 29680 tablet_bootstrap.cc:492] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Bootstrap starting.
I20260811 16:46:31.320096 29681 tablet_bootstrap.cc:492] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: Bootstrap starting.
I20260811 16:46:31.320375 29680 tablet_bootstrap.cc:654] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:31.320493 29683 tablet_bootstrap.cc:492] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7: Bootstrap starting.
I20260811 16:46:31.320796 29681 tablet_bootstrap.cc:654] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:31.320999 29680 log.cc:824] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:31.321118 29681 log.cc:824] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:31.321144 29683 tablet_bootstrap.cc:654] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:31.321425 29683 log.cc:824] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:31.321964 29681 tablet_bootstrap.cc:492] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: No bootstrap required, opened a new log
I20260811 16:46:31.322057 29681 ts_tablet_manager.cc:1397] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 16:46:31.322093 29680 tablet_bootstrap.cc:492] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: No bootstrap required, opened a new log
I20260811 16:46:31.322165 29680 ts_tablet_manager.cc:1397] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 16:46:31.323904 29681 raft_consensus.cc:348] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.324054 29681 raft_consensus.cc:374] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:31.323958 29680 raft_consensus.cc:348] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.324079 29681 raft_consensus.cc:729] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6917d1ba8694d20a50f23fd6e6d0db5, State: Initialized, Role: FOLLOWER
I20260811 16:46:31.324101 29680 raft_consensus.cc:374] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:31.324150 29680 raft_consensus.cc:729] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c149a8697924f2190b8fabbd8ad7eed, State: Initialized, Role: FOLLOWER
I20260811 16:46:31.324205 29681 consensus_queue.cc:260] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.324270 29680 consensus_queue.cc:260] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.324468 29681 ts_tablet_manager.cc:1428] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:46:31.324566 29680 ts_tablet_manager.cc:1428] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 16:46:31.324597 29451 heartbeater.cc:503] Master 127.27.186.126:34287 was elected leader, sending a full tablet report...
I20260811 16:46:31.324610 29656 heartbeater.cc:503] Master 127.27.186.126:34287 was elected leader, sending a full tablet report...
I20260811 16:46:31.325664 29683 tablet_bootstrap.cc:492] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7: No bootstrap required, opened a new log
I20260811 16:46:31.325745 29683 ts_tablet_manager.cc:1397] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 16:46:31.327816 29683 raft_consensus.cc:348] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.327996 29683 raft_consensus.cc:374] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:31.328055 29683 raft_consensus.cc:729] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 894cbc4645d44d8eb9b03438457463a7, State: Initialized, Role: FOLLOWER
I20260811 16:46:31.328183 29683 consensus_queue.cc:260] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.328451 29683 ts_tablet_manager.cc:1428] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 16:46:31.328567 29231 heartbeater.cc:503] Master 127.27.186.126:34287 was elected leader, sending a full tablet report...
W20260811 16:46:31.365567 29452 tablet.cc:2369] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 16:46:31.477870 29234 tablet.cc:2369] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 16:46:31.479329 29696 raft_consensus.cc:482] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 16:46:31.479435 29696 raft_consensus.cc:504] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.479773 29696 leader_election.cc:288] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6917d1ba8694d20a50f23fd6e6d0db5 (127.27.186.67:32943), 3c149a8697924f2190b8fabbd8ad7eed (127.27.186.66:35565)
I20260811 16:46:31.482678 29672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.480078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:36243 (local address 127.27.186.66:35565)
0811 16:46:31.480169 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.480171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.480193 (+ 22us) server_negotiation.cc:407] Connection header received
0811 16:46:31.480227 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.480228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.480242 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.480297 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:31.480464 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.480940 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.481949 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.482313 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.482408 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.482418 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.482567 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.482604 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 16:46:31.482678 29238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.479980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.66:35565 (local address 127.27.186.65:36243)
0811 16:46:31.480020 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:31.480033 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:31.480081 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:31.480300 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:31.480300 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:31.480302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:31.480380 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.480383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.481052 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.481053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.481849 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.481851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.482409 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.482409 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.482480 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.482484 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 16:46:31.482560 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 16:46:31.482604 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 16:46:31.482954 29678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.480081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.27.186.65:55089 (local address 127.27.186.67:32943)
0811 16:46:31.480170 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.480173 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.480381 (+ 208us) server_negotiation.cc:407] Connection header received
0811 16:46:31.480460 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.480461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.480471 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.480535 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 16:46:31.480724 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.481196 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.482203 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.482568 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.482651 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.482659 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.482840 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.482884 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 16:46:31.482965 29699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.479980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.67:32943 (local address 127.27.186.65:55089)
0811 16:46:31.480290 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:31.480299 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:46:31.480393 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:46:31.480552 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:46:31.480553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:46:31.480555 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 16:46:31.480639 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.480640 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.481281 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.481282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.482102 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:46:31.482104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.482651 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.482652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:46:31.482724 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.482727 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 16:46:31.482829 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 16:46:31.482879 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":177,"thread_start_us":80,"threads_started":1}
I20260811 16:46:31.483067 29380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2756479e6ccb4e81be9ec94aebca32d4" candidate_uuid: "894cbc4645d44d8eb9b03438457463a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c149a8697924f2190b8fabbd8ad7eed" is_pre_election: true
I20260811 16:46:31.483253 29380 raft_consensus.cc:2454] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 894cbc4645d44d8eb9b03438457463a7 in term 0.
I20260811 16:46:31.483484 29583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2756479e6ccb4e81be9ec94aebca32d4" candidate_uuid: "894cbc4645d44d8eb9b03438457463a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" is_pre_election: true
I20260811 16:46:31.483515 29057 leader_election.cc:302] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c149a8697924f2190b8fabbd8ad7eed, 894cbc4645d44d8eb9b03438457463a7; no voters:
I20260811 16:46:31.483634 29583 raft_consensus.cc:2454] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 894cbc4645d44d8eb9b03438457463a7 in term 0.
I20260811 16:46:31.483635 29696 raft_consensus.cc:2781] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 16:46:31.483687 29696 raft_consensus.cc:482] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 16:46:31.483736 29696 raft_consensus.cc:3037] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:31.484678 29696 raft_consensus.cc:504] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.484824 29696 leader_election.cc:288] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [CANDIDATE]: Term 1 election: Requested vote from peers b6917d1ba8694d20a50f23fd6e6d0db5 (127.27.186.67:32943), 3c149a8697924f2190b8fabbd8ad7eed (127.27.186.66:35565)
I20260811 16:46:31.485004 29380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2756479e6ccb4e81be9ec94aebca32d4" candidate_uuid: "894cbc4645d44d8eb9b03438457463a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c149a8697924f2190b8fabbd8ad7eed"
I20260811 16:46:31.485002 29583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2756479e6ccb4e81be9ec94aebca32d4" candidate_uuid: "894cbc4645d44d8eb9b03438457463a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5"
I20260811 16:46:31.485105 29583 raft_consensus.cc:3037] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:31.485103 29380 raft_consensus.cc:3037] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:31.486025 29380 raft_consensus.cc:2454] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 894cbc4645d44d8eb9b03438457463a7 in term 1.
I20260811 16:46:31.486061 29583 raft_consensus.cc:2454] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 894cbc4645d44d8eb9b03438457463a7 in term 1.
I20260811 16:46:31.486234 29055 leader_election.cc:302] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 894cbc4645d44d8eb9b03438457463a7, b6917d1ba8694d20a50f23fd6e6d0db5; no voters:
I20260811 16:46:31.486337 29696 raft_consensus.cc:2781] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:31.486536 29696 raft_consensus.cc:686] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [term 1 LEADER]: Becoming Leader. State: Replica: 894cbc4645d44d8eb9b03438457463a7, State: Running, Role: LEADER
I20260811 16:46:31.486639 29696 consensus_queue.cc:237] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } }
I20260811 16:46:31.487432 28937 catalog_manager.cc:5495] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 894cbc4645d44d8eb9b03438457463a7 (127.27.186.65). New cstate: current_term: 1 leader_uuid: "894cbc4645d44d8eb9b03438457463a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "894cbc4645d44d8eb9b03438457463a7" member_type: VOTER last_known_addr { host: "127.27.186.65" port: 43795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 } health_report { overall_health: UNKNOWN } } }
I20260811 16:46:31.495434 29679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.493247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42512 (local address 127.27.186.65:43795)
0811 16:46:31.493307 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:31.493309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:31.493317 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:46:31.493364 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:31.493365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:31.493381 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:31.493441 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:46:31.493611 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.494061 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.494751 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:31.494932 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:31.494991 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:31.495113 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:46:31.495205 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:46:31.495265 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:31.495296 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 16:46:31.495311 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 16:46:31.497295 29380 raft_consensus.cc:1261] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 1 FOLLOWER]: Refusing update from remote peer 894cbc4645d44d8eb9b03438457463a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:31.497295 29583 raft_consensus.cc:1261] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 1 FOLLOWER]: Refusing update from remote peer 894cbc4645d44d8eb9b03438457463a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:46:31.497730 29700 consensus_queue.cc:1035] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6917d1ba8694d20a50f23fd6e6d0db5" member_type: VOTER last_known_addr { host: "127.27.186.67" port: 32943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:31.497900 29696 consensus_queue.cc:1035] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c149a8697924f2190b8fabbd8ad7eed" member_type: VOTER last_known_addr { host: "127.27.186.66" port: 35565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:46:31.500384 29704 mvcc.cc:205] Tried to move back new op lower bound from 7317367977970085888 to 7317367977929891840. Current Snapshot: MvccSnapshot[applied={T|T < 7317367977970085888}]
I20260811 16:46:31.503501 28937 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:31.503605 28937 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 16:46:31.505509 28937 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48647dbe8e3d4e72bb2d048989184c2f: Sending DeleteTablet for 3 replicas of tablet 2756479e6ccb4e81be9ec94aebca32d4
I20260811 16:46:31.505976 29352 tablet_service.cc:1514] Processing DeleteTablet for tablet 2756479e6ccb4e81be9ec94aebca32d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:31 UTC) from {username='slave'} at 127.0.0.1:52058
I20260811 16:46:31.505973 29129 tablet_service.cc:1514] Processing DeleteTablet for tablet 2756479e6ccb4e81be9ec94aebca32d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:31 UTC) from {username='slave'} at 127.0.0.1:42502
I20260811 16:46:31.506208 29721 tablet_replica.cc:330] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: stopping tablet replica
I20260811 16:46:31.506210 29556 tablet_service.cc:1514] Processing DeleteTablet for tablet 2756479e6ccb4e81be9ec94aebca32d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:46:31 UTC) from {username='slave'} at 127.0.0.1:57178
I20260811 16:46:31.506312 29721 raft_consensus.cc:2229] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:31.506420 29721 raft_consensus.cc:2258] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:31.506484 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29028
I20260811 16:46:31.506641 29728 tablet_replica.cc:330] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: stopping tablet replica
I20260811 16:46:31.506735 29728 raft_consensus.cc:2229] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 16:46:31.506819 29728 raft_consensus.cc:2258] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 16:46:31.506934 29727 tablet_replica.cc:330] T 2756479e6ccb4e81be9ec94aebca32d4 P 894cbc4645d44d8eb9b03438457463a7: stopping tablet replica
I20260811 16:46:31.510010 29728 ts_tablet_manager.cc:1905] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:31.512461 29728 ts_tablet_manager.cc:1918] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:31.512562 29728 log.cc:1196] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-2/wal/wals/2756479e6ccb4e81be9ec94aebca32d4
I20260811 16:46:31.512871 29728 ts_tablet_manager.cc:1939] T 2756479e6ccb4e81be9ec94aebca32d4 P b6917d1ba8694d20a50f23fd6e6d0db5: Deleting consensus metadata
I20260811 16:46:31.513635 28906 catalog_manager.cc:4841] TS b6917d1ba8694d20a50f23fd6e6d0db5 (127.27.186.67:32943): tablet 2756479e6ccb4e81be9ec94aebca32d4 (table test-table [id=fd2acbf5137e4e3dacf1175da3cdeeba]) successfully deleted
I20260811 16:46:31.515901 29721 ts_tablet_manager.cc:1905] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 16:46:31.517472 29721 ts_tablet_manager.cc:1918] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 16:46:31.517627 29721 log.cc:1196] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Deleting WAL directory at /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786466533930122-28393-0/minicluster-data/ts-1/wal/wals/2756479e6ccb4e81be9ec94aebca32d4
I20260811 16:46:31.517881 29721 ts_tablet_manager.cc:1939] T 2756479e6ccb4e81be9ec94aebca32d4 P 3c149a8697924f2190b8fabbd8ad7eed: Deleting consensus metadata
I20260811 16:46:31.518362 28907 catalog_manager.cc:4841] TS 3c149a8697924f2190b8fabbd8ad7eed (127.27.186.66:35565): tablet 2756479e6ccb4e81be9ec94aebca32d4 (table test-table [id=fd2acbf5137e4e3dacf1175da3cdeeba]) successfully deleted
W20260811 16:46:31.520553 28906 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.186.65:43795 (error 108)
I20260811 16:46:31.521116 29671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:31.520952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.65:43795 (local address 127.0.0.1:42526)
0811 16:46:31.521028 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 16:46:31.521076 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.65:43795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 16:46:31.521142 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29239
W20260811 16:46:31.521246 28906 catalog_manager.cc:4584] TS 894cbc4645d44d8eb9b03438457463a7 (127.27.186.65:43795): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2756479e6ccb4e81be9ec94aebca32d4: Network error: Client connection negotiation failed: client connection to 127.27.186.65:43795: connect: Connection refused (error 111)
I20260811 16:46:31.540423 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29456
I20260811 16:46:31.550844 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 28881
2026-08-11T16:46:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (941 ms)
[----------] 6 tests from EncryptionPolicyTest (9401 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:31 dist-test-slave-gsp7 krb5kdc[29734](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:31 dist-test-slave-gsp7 krb5kdc[29734](info): set up 2 sockets
Aug 11 16:46:31 dist-test-slave-gsp7 krb5kdc[29734](info): commencing operation
krb5kdc: starting...
W20260811 16:46:32.847520 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:32 dist-test-slave-gsp7 krb5kdc[29734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:32.981092 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40265
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:33.067104 29759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:33.067364 29759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:33.067408 29759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:33.068567 29759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:33.068637 29759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:33.068662 29759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:33.068684 29759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:33.068711 29759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:33.070252 29759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40265
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:33.070559 29759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:33.070797 29759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:33.075836 29767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:33.075964 29759 server_base.cc:1034] running on GCE node
W20260811 16:46:33.075872 29772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:33.075865 29768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:33.076390 29759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:33.076737 29759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:33.077929 29759 hybrid_clock.cc:648] HybridClock initialized: now 1786466793077909 us; error 37 us; skew 500 ppm
Aug 11 16:46:33 dist-test-slave-gsp7 krb5kdc[29734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466793, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:33.085742 29759 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:33.086232 29759 webserver.cc:460] Webserver started at http://127.0.0.1:36957/ using document root <none> and password file <none>
I20260811 16:46:33.086484 29759 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:33.086552 29759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:33.086715 29759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:33.088016 29759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "f544899e31d64353a35eca55bd7b8751"
format_stamp: "Formatted at 2026-08-11 16:46:33 on dist-test-slave-gsp7"
server_key: "9363e071c6af528557f5416a1bed380e"
server_key_iv: "f1de2399f87dadd9110f4ecb66baffee"
server_key_version: "encryptionkey@0"
I20260811 16:46:33.088405 29759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "f544899e31d64353a35eca55bd7b8751"
format_stamp: "Formatted at 2026-08-11 16:46:33 on dist-test-slave-gsp7"
server_key: "9363e071c6af528557f5416a1bed380e"
server_key_iv: "f1de2399f87dadd9110f4ecb66baffee"
server_key_version: "encryptionkey@0"
I20260811 16:46:33.089913 29759 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:33.090709 29781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:33.090884 29759 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:33.090991 29759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "f544899e31d64353a35eca55bd7b8751"
format_stamp: "Formatted at 2026-08-11 16:46:33 on dist-test-slave-gsp7"
server_key: "9363e071c6af528557f5416a1bed380e"
server_key_iv: "f1de2399f87dadd9110f4ecb66baffee"
server_key_version: "encryptionkey@0"
I20260811 16:46:33.091065 29759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:33.110239 29759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:33.112723 29759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:33.112908 29759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:33.117323 29759 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40265
I20260811 16:46:33.117373 29864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40265 every 8 connection(s)
I20260811 16:46:33.117769 29759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:33.118657 29865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:33.120951 29865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751: Bootstrap starting.
I20260811 16:46:33.121573 29865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:33.121842 29865 log.cc:824] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:33.122550 29865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751: No bootstrap required, opened a new log
I20260811 16:46:33.124133 29865 raft_consensus.cc:348] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f544899e31d64353a35eca55bd7b8751" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } }
I20260811 16:46:33.124279 29865 raft_consensus.cc:374] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:33.124302 29865 raft_consensus.cc:729] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f544899e31d64353a35eca55bd7b8751, State: Initialized, Role: FOLLOWER
I20260811 16:46:33.124441 29865 consensus_queue.cc:260] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f544899e31d64353a35eca55bd7b8751" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } }
I20260811 16:46:33.124524 29865 raft_consensus.cc:388] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:33.124548 29865 raft_consensus.cc:482] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:33.124577 29865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:33.125098 29865 raft_consensus.cc:504] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f544899e31d64353a35eca55bd7b8751" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } }
I20260811 16:46:33.125185 29865 leader_election.cc:302] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f544899e31d64353a35eca55bd7b8751; no voters:
I20260811 16:46:33.125309 29865 leader_election.cc:288] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:33.125380 29870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:33.125583 29865 sys_catalog.cc:564] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:33.125622 29870 raft_consensus.cc:686] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [term 1 LEADER]: Becoming Leader. State: Replica: f544899e31d64353a35eca55bd7b8751, State: Running, Role: LEADER
I20260811 16:46:33.125722 29870 consensus_queue.cc:237] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f544899e31d64353a35eca55bd7b8751" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } }
I20260811 16:46:33.126253 29871 sys_catalog.cc:455] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f544899e31d64353a35eca55bd7b8751" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f544899e31d64353a35eca55bd7b8751" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } } }
I20260811 16:46:33.126406 29872 sys_catalog.cc:455] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f544899e31d64353a35eca55bd7b8751. Latest consensus state: current_term: 1 leader_uuid: "f544899e31d64353a35eca55bd7b8751" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f544899e31d64353a35eca55bd7b8751" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40265 } } }
I20260811 16:46:33.126487 29871 sys_catalog.cc:458] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:33.126513 29872 sys_catalog.cc:458] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:33.126885 29891 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:33.127408 29891 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:33.127523 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29759
I20260811 16:46:33.127638 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:33.127842 28393 external_mini_cluster.cc:1428] Setting key b949ca5bec8578af7ddf6b4031c71224
I20260811 16:46:33.129017 29891 catalog_manager.cc:1347] Generated new cluster ID: 04903af7e3154d3bb191b6d0641d235e
I20260811 16:46:33.129070 29891 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:46:33 dist-test-slave-gsp7 krb5kdc[29734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:46:33.140434 29899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:33.128352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49509 (local address 127.0.0.1:40265)
0811 16:46:33.128528 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:33.128538 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:33.128634 (+ 96us) server_negotiation.cc:407] Connection header received
0811 16:46:33.128802 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:33.128810 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:33.128868 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:33.129020 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:33.130042 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:33.131479 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:33.132621 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:33.133273 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:33.133381 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:33.136505 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:33.136509 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:33.136509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:33.136522 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:33.138578 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:33.139055 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:33.139058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:33.139058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:33.139181 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:33.139431 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:33.139432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:33.139432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:33.139738 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:33.139903 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:33.140075 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 16:46:33.140183 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260811 16:46:33.141547 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:33.150295 29891 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:33.150779 29891 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:33.150888 29899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:33.142971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36597 (local address 127.0.0.1:40265)
0811 16:46:33.143032 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:33.143034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:33.143283 (+ 249us) server_negotiation.cc:407] Connection header received
0811 16:46:33.143331 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:33.143332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:33.143343 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:33.143409 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:33.143993 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:33.144838 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:33.145846 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:33.146196 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:33.146262 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:33.147634 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:33.147635 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:33.147635 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:33.147643 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:33.149263 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:33.149737 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:33.149739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:33.149739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:33.149797 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:33.150065 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:33.150066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:33.150067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:33.150210 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:33.150331 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:33.150661 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 16:46:33.150734 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:46:33.159503 29891 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f544899e31d64353a35eca55bd7b8751: Generated new TSK 0
I20260811 16:46:33.159720 29891 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:33.164196 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29759
W20260811 16:46:33.177582 29732 connection.cc:535] client connection to 127.0.0.1:40265 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40265): Connection reset by peer (error 104)
2026-08-11T16:46:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1609 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:33 dist-test-slave-gsp7 krb5kdc[29923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:33 dist-test-slave-gsp7 krb5kdc[29923](info): set up 2 sockets
Aug 11 16:46:33 dist-test-slave-gsp7 krb5kdc[29923](info): commencing operation
krb5kdc: starting...
W20260811 16:46:34.436750 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:34 dist-test-slave-gsp7 krb5kdc[29923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:34.567936 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33805
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33805
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:34.652612 29945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:34.652842 29945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:34.652868 29945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:34.654073 29945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:34.654122 29945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:34.654136 29945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:34.654150 29945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:34.654163 29945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:34.655699 29945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33805
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:34.655967 29945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:34.656208 29945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:34.661432 29955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:34.661448 29950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:34.661545 29945 server_base.cc:1034] running on GCE node
W20260811 16:46:34.661532 29951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:34.662009 29945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:34.662266 29945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:34.663403 29945 hybrid_clock.cc:648] HybridClock initialized: now 1786466794663394 us; error 29 us; skew 500 ppm
Aug 11 16:46:34 dist-test-slave-gsp7 krb5kdc[29923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466794, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:34.665903 29945 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:34.666391 29945 webserver.cc:460] Webserver started at http://127.0.0.1:42119/ using document root <none> and password file <none>
I20260811 16:46:34.666611 29945 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:34.666678 29945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:34.666824 29945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:34.667892 29945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "dcc26d6de0c247848fb6a24915a7ceab"
format_stamp: "Formatted at 2026-08-11 16:46:34 on dist-test-slave-gsp7"
server_key: "fbc77ce96183049524ab069b3d42582e"
server_key_iv: "127ddcd535780c0045ed87e1af570be1"
server_key_version: "encryptionkey@0"
I20260811 16:46:34.668279 29945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "dcc26d6de0c247848fb6a24915a7ceab"
format_stamp: "Formatted at 2026-08-11 16:46:34 on dist-test-slave-gsp7"
server_key: "fbc77ce96183049524ab069b3d42582e"
server_key_iv: "127ddcd535780c0045ed87e1af570be1"
server_key_version: "encryptionkey@0"
I20260811 16:46:34.669669 29945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:34.670419 29965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:34.670590 29945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:46:34.670696 29945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "dcc26d6de0c247848fb6a24915a7ceab"
format_stamp: "Formatted at 2026-08-11 16:46:34 on dist-test-slave-gsp7"
server_key: "fbc77ce96183049524ab069b3d42582e"
server_key_iv: "127ddcd535780c0045ed87e1af570be1"
server_key_version: "encryptionkey@0"
I20260811 16:46:34.670768 29945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:34.698436 29945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:34.700487 29945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:34.700672 29945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:34.705101 29945 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33805
I20260811 16:46:34.705149 30045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33805 every 8 connection(s)
I20260811 16:46:34.705591 29945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:34.706509 30047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:34.709004 30047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab: Bootstrap starting.
I20260811 16:46:34.709676 30047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:34.709990 30047 log.cc:824] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:34.710769 30047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab: No bootstrap required, opened a new log
I20260811 16:46:34.712443 30047 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcc26d6de0c247848fb6a24915a7ceab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33805 } }
I20260811 16:46:34.712596 30047 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:34.712620 30047 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcc26d6de0c247848fb6a24915a7ceab, State: Initialized, Role: FOLLOWER
I20260811 16:46:34.712812 30047 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcc26d6de0c247848fb6a24915a7ceab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33805 } }
I20260811 16:46:34.712911 30047 raft_consensus.cc:388] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:34.712962 30047 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:34.713027 30047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:34.713636 30047 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcc26d6de0c247848fb6a24915a7ceab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33805 } }
I20260811 16:46:34.713752 30047 leader_election.cc:302] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcc26d6de0c247848fb6a24915a7ceab; no voters:
I20260811 16:46:34.713958 30047 leader_election.cc:288] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:34.713986 30053 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:34.713994 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 29945
I20260811 16:46:34.714124 30053 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [term 1 LEADER]: Becoming Leader. State: Replica: dcc26d6de0c247848fb6a24915a7ceab, State: Running, Role: LEADER
I20260811 16:46:34.714148 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:34.714202 30053 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcc26d6de0c247848fb6a24915a7ceab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33805 } }
I20260811 16:46:34.714257 30047 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:34.714350 28393 external_mini_cluster.cc:1428] Setting key d1ed56c34ba92ebf0e812cb117687204
I20260811 16:46:34.714538 30053 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcc26d6de0c247848fb6a24915a7ceab. Latest consensus state: current_term: 1 leader_uuid: "dcc26d6de0c247848fb6a24915a7ceab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcc26d6de0c247848fb6a24915a7ceab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33805 } } }
I20260811 16:46:34.714609 30053 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:34.714558 30054 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcc26d6de0c247848fb6a24915a7ceab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcc26d6de0c247848fb6a24915a7ceab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33805 } } }
I20260811 16:46:34.714648 30054 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:34.715408 30057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:34.716004 30057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:34.719128 30057 catalog_manager.cc:1347] Generated new cluster ID: 14655137fd464e86b763f80d1ba86867
I20260811 16:46:34.719229 30057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:34.722122 30059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:34.714964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43977 (local address 127.0.0.1:33805)
0811 16:46:34.715195 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:34.715206 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:34.715256 (+ 50us) server_negotiation.cc:407] Connection header received
0811 16:46:34.715382 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:34.715391 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:34.715510 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:34.715677 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:34.715947 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:34.717365 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:34.718659 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:34.719749 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:34.720454 (+ 705us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:34.721004 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:34.721008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:34.721009 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:34.721348 (+ 339us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:34.721394 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:34.721438 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:34.721772 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:34.721852 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 16:46:34.721886 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":77,"threads_started":1}
I20260811 16:46:34.724426 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:34.730355 30059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:34.727096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40407 (local address 127.0.0.1:33805)
0811 16:46:34.727179 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:34.727182 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:34.727360 (+ 178us) server_negotiation.cc:407] Connection header received
0811 16:46:34.727458 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:34.727459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:34.727472 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:34.727504 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:34.727762 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:34.728265 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:34.729005 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:34.729222 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:34.729302 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:34.730067 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:34.730069 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:34.730069 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:34.730074 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:34.730088 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:34.730098 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:34.730165 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:34.730233 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 16:46:34.730248 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 16:46:34.740768 30057 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:34.741532 30057 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:34.746250 30057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcc26d6de0c247848fb6a24915a7ceab: Generated new TSK 0
I20260811 16:46:34.746472 30057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:34.750833 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 29945
W20260811 16:46:34.766433 29916 connection.cc:535] client connection to 127.0.0.1:33805 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33805): Connection reset by peer (error 104)
2026-08-11T16:46:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1588 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:34 dist-test-slave-gsp7 krb5kdc[30105](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:34 dist-test-slave-gsp7 krb5kdc[30105](info): set up 2 sockets
Aug 11 16:46:34 dist-test-slave-gsp7 krb5kdc[30105](info): commencing operation
krb5kdc: starting...
W20260811 16:46:36.036149 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:36 dist-test-slave-gsp7 krb5kdc[30105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466796, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:36.164737 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39277
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:36.248719 30128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:36.249015 30128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:36.249059 30128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:36.250376 30128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:36.250464 30128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:36.250488 30128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:36.250509 30128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:36.250541 30128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:36.252174 30128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39277
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:36.252490 30128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:36.252743 30128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:36.257843 30135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:36.257854 30138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:36.257876 30140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:36.258092 30128 server_base.cc:1034] running on GCE node
I20260811 16:46:36.258328 30128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:36.258679 30128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:36.259861 30128 hybrid_clock.cc:648] HybridClock initialized: now 1786466796259846 us; error 45 us; skew 500 ppm
Aug 11 16:46:36 dist-test-slave-gsp7 krb5kdc[30105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466796, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:36.262441 30128 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:36.262930 30128 webserver.cc:460] Webserver started at http://127.0.0.1:36313/ using document root <none> and password file <none>
I20260811 16:46:36.263183 30128 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:36.263255 30128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:36.263404 30128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:36.264500 30128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "eec9369bad7a4b70829688ccf5a5e209"
format_stamp: "Formatted at 2026-08-11 16:46:36 on dist-test-slave-gsp7"
server_key: "bf0cafdd487a26b964edc92b2304f238"
server_key_iv: "46da0a657f3187587cfe177ecfa237a7"
server_key_version: "encryptionkey@0"
I20260811 16:46:36.264879 30128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "eec9369bad7a4b70829688ccf5a5e209"
format_stamp: "Formatted at 2026-08-11 16:46:36 on dist-test-slave-gsp7"
server_key: "bf0cafdd487a26b964edc92b2304f238"
server_key_iv: "46da0a657f3187587cfe177ecfa237a7"
server_key_version: "encryptionkey@0"
I20260811 16:46:36.266335 30128 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:46:36.267093 30148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:36.267270 30128 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:36.267381 30128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "eec9369bad7a4b70829688ccf5a5e209"
format_stamp: "Formatted at 2026-08-11 16:46:36 on dist-test-slave-gsp7"
server_key: "bf0cafdd487a26b964edc92b2304f238"
server_key_iv: "46da0a657f3187587cfe177ecfa237a7"
server_key_version: "encryptionkey@0"
I20260811 16:46:36.267462 30128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:36.270888 30128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:36.272830 30128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:36.273003 30128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:36.277370 30128 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39277
I20260811 16:46:36.277406 30231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39277 every 8 connection(s)
I20260811 16:46:36.277796 30128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:36.278828 30232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:36.280623 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30128
I20260811 16:46:36.280745 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:36.280968 28393 external_mini_cluster.cc:1428] Setting key 952685f762500c934ec7e301092ed812
I20260811 16:46:36.281641 30232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209: Bootstrap starting.
I20260811 16:46:36.282277 30232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:36.282635 30232 log.cc:824] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:36.283507 30232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209: No bootstrap required, opened a new log
I20260811 16:46:36.283690 30236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:36.281552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47971 (local address 127.0.0.1:39277)
0811 16:46:36.281754 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:36.281763 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:36.281798 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:46:36.282224 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:36.282231 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:36.282255 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:36.282415 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:36.283171 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:36.283175 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:36.283176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:36.283181 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:36.283231 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:36.283245 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:36.283345 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:36.283379 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 16:46:36.283421 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260811 16:46:36.284742 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:36.285894 30232 raft_consensus.cc:348] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec9369bad7a4b70829688ccf5a5e209" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39277 } }
I20260811 16:46:36.286067 30232 raft_consensus.cc:374] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:36.286116 30232 raft_consensus.cc:729] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec9369bad7a4b70829688ccf5a5e209, State: Initialized, Role: FOLLOWER
I20260811 16:46:36.286243 30232 consensus_queue.cc:260] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec9369bad7a4b70829688ccf5a5e209" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39277 } }
I20260811 16:46:36.286373 30232 raft_consensus.cc:388] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:36.286419 30232 raft_consensus.cc:482] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:36.286468 30232 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:36.287286 30236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:36.286349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41829 (local address 127.0.0.1:39277)
0811 16:46:36.286404 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:36.286406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:36.286417 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:46:36.286539 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:36.286540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:36.286545 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:36.286596 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:36.287111 (+ 515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:36.287113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:36.287113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:36.287117 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:36.287131 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:36.287135 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:36.287179 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:36.287235 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 16:46:36.287245 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 16:46:36.287319 30232 raft_consensus.cc:504] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec9369bad7a4b70829688ccf5a5e209" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39277 } }
I20260811 16:46:36.287428 30232 leader_election.cc:302] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eec9369bad7a4b70829688ccf5a5e209; no voters:
I20260811 16:46:36.287596 30232 leader_election.cc:288] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:36.287635 30248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:36.287823 30248 raft_consensus.cc:686] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [term 1 LEADER]: Becoming Leader. State: Replica: eec9369bad7a4b70829688ccf5a5e209, State: Running, Role: LEADER
I20260811 16:46:36.287865 30232 sys_catalog.cc:564] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:36.287949 30248 consensus_queue.cc:237] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec9369bad7a4b70829688ccf5a5e209" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39277 } }
I20260811 16:46:36.288306 30251 sys_catalog.cc:455] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eec9369bad7a4b70829688ccf5a5e209. Latest consensus state: current_term: 1 leader_uuid: "eec9369bad7a4b70829688ccf5a5e209" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec9369bad7a4b70829688ccf5a5e209" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39277 } } }
I20260811 16:46:36.288297 30249 sys_catalog.cc:455] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eec9369bad7a4b70829688ccf5a5e209" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec9369bad7a4b70829688ccf5a5e209" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39277 } } }
I20260811 16:46:36.288434 30251 sys_catalog.cc:458] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:36.288445 30249 sys_catalog.cc:458] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:36.288676 30262 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:36.289384 30262 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:36.291059 30262 catalog_manager.cc:1347] Generated new cluster ID: 93391fb4400f4f3e896e6f87316fb892
I20260811 16:46:36.291122 30262 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:36.296758 30262 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:36.296917 30262 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:36.301649 30262 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eec9369bad7a4b70829688ccf5a5e209: Generated new TSK 0
I20260811 16:46:36.301822 30262 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:36.308231 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30128
2026-08-11T16:46:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1569 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:36 dist-test-slave-gsp7 krb5kdc[30285](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:36 dist-test-slave-gsp7 krb5kdc[30285](info): set up 2 sockets
Aug 11 16:46:36 dist-test-slave-gsp7 krb5kdc[30285](info): commencing operation
krb5kdc: starting...
W20260811 16:46:37.607005 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:37 dist-test-slave-gsp7 krb5kdc[30285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:37.737838 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37463
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:37.822399 30307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:37.822615 30307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:37.822638 30307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:37.823845 30307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:37.823891 30307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:37.823906 30307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:37.823948 30307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:37.823978 30307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:37.825445 30307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:37.825726 30307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:37.825968 30307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:37.831060 30313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:37.831123 30314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:37.831172 30307 server_base.cc:1034] running on GCE node
W20260811 16:46:37.831060 30318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:37.831609 30307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:37.831912 30307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:37.833086 30307 hybrid_clock.cc:648] HybridClock initialized: now 1786466797833067 us; error 50 us; skew 500 ppm
Aug 11 16:46:37 dist-test-slave-gsp7 krb5kdc[30285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466797, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:37.835765 30307 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:37.836223 30307 webserver.cc:460] Webserver started at http://127.0.0.1:43603/ using document root <none> and password file <none>
I20260811 16:46:37.836460 30307 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:37.836541 30307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:37.836704 30307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:37.837891 30307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "1c75a8b7eb9945acac5f79d542c6b6aa"
format_stamp: "Formatted at 2026-08-11 16:46:37 on dist-test-slave-gsp7"
server_key: "f5175952f5173a7236cd374a1e9b68d9"
server_key_iv: "068aba67d18e2a4224232a061f3888f4"
server_key_version: "encryptionkey@0"
I20260811 16:46:37.838275 30307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "1c75a8b7eb9945acac5f79d542c6b6aa"
format_stamp: "Formatted at 2026-08-11 16:46:37 on dist-test-slave-gsp7"
server_key: "f5175952f5173a7236cd374a1e9b68d9"
server_key_iv: "068aba67d18e2a4224232a061f3888f4"
server_key_version: "encryptionkey@0"
I20260811 16:46:37.839717 30307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:46:37.840510 30329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:37.840703 30307 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:37.840814 30307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "1c75a8b7eb9945acac5f79d542c6b6aa"
format_stamp: "Formatted at 2026-08-11 16:46:37 on dist-test-slave-gsp7"
server_key: "f5175952f5173a7236cd374a1e9b68d9"
server_key_iv: "068aba67d18e2a4224232a061f3888f4"
server_key_version: "encryptionkey@0"
I20260811 16:46:37.840893 30307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:37.853888 30307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:37.855734 30307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:37.855901 30307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:37.860664 30307 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37463
I20260811 16:46:37.860699 30417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37463 every 8 connection(s)
I20260811 16:46:37.861092 30307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:37.862145 30418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:37.863523 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30307
I20260811 16:46:37.863634 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:37.863863 28393 external_mini_cluster.cc:1428] Setting key df3d7378df3d10581ce71d6034b142f3
I20260811 16:46:37.865180 30418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa: Bootstrap starting.
I20260811 16:46:37.865968 30418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:37.866326 30418 log.cc:824] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:37.867162 30418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa: No bootstrap required, opened a new log
I20260811 16:46:37.869554 30418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c75a8b7eb9945acac5f79d542c6b6aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37463 } }
I20260811 16:46:37.869728 30418 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:37.869778 30418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c75a8b7eb9945acac5f79d542c6b6aa, State: Initialized, Role: FOLLOWER
I20260811 16:46:37.869918 30418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c75a8b7eb9945acac5f79d542c6b6aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37463 } }
I20260811 16:46:37.870039 30418 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:37.870088 30418 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:37.870143 30418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:37.870739 30418 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c75a8b7eb9945acac5f79d542c6b6aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37463 } }
I20260811 16:46:37.870869 30418 leader_election.cc:302] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c75a8b7eb9945acac5f79d542c6b6aa; no voters:
I20260811 16:46:37.871088 30418 leader_election.cc:288] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:37.871114 30427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:37.871230 30427 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [term 1 LEADER]: Becoming Leader. State: Replica: 1c75a8b7eb9945acac5f79d542c6b6aa, State: Running, Role: LEADER
I20260811 16:46:37.871372 30418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:37.871378 30427 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c75a8b7eb9945acac5f79d542c6b6aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37463 } }
Aug 11 16:46:37 dist-test-slave-gsp7 krb5kdc[30285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:46:37.871846 30427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c75a8b7eb9945acac5f79d542c6b6aa. Latest consensus state: current_term: 1 leader_uuid: "1c75a8b7eb9945acac5f79d542c6b6aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c75a8b7eb9945acac5f79d542c6b6aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37463 } } }
I20260811 16:46:37.871871 30432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c75a8b7eb9945acac5f79d542c6b6aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c75a8b7eb9945acac5f79d542c6b6aa" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37463 } } }
I20260811 16:46:37.872030 30427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:37.872043 30432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:37.872285 30443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:37.873070 30443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:37.875795 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:37.864507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45085 (local address 127.0.0.1:37463)
0811 16:46:37.864736 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:37.864747 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:37.864786 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:46:37.865392 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:37.865401 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:37.865464 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:37.865685 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:37.866362 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:37.867701 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:37.868458 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:37.869167 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:37.869295 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:37.872222 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:37.872226 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:37.872227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:37.872239 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:37.874236 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:37.874657 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:37.874659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:37.874659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:37.874742 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:37.874963 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:37.874964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:37.874964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:37.875185 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:37.875289 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:37.875444 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 16:46:37.875550 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":99,"threads_started":1}
I20260811 16:46:37.876878 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:37.878602 30443 catalog_manager.cc:1347] Generated new cluster ID: f6a97cfe24b94eef99ccf3579b4f2c42
I20260811 16:46:37.878674 30443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:37.886104 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:37.878439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59017 (local address 127.0.0.1:37463)
0811 16:46:37.878478 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:37.878479 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:37.878742 (+ 263us) server_negotiation.cc:407] Connection header received
0811 16:46:37.878807 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:37.878808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:37.878826 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:37.878891 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:37.879558 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:37.880303 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:37.881346 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:37.881724 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:37.881787 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:37.883245 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:37.883246 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:37.883247 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:37.883254 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:37.884820 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:37.885234 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:37.885235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:37.885236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:37.885292 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:37.885527 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:37.885528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:37.885528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:37.885653 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:37.885744 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:37.885889 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 16:46:37.885992 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:46:37.889371 30443 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:37.889902 30443 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:37.899441 30443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c75a8b7eb9945acac5f79d542c6b6aa: Generated new TSK 0
I20260811 16:46:37.899681 30443 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:37.905242 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30307
2026-08-11T16:46:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1586 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:37 dist-test-slave-gsp7 krb5kdc[30463](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:37 dist-test-slave-gsp7 krb5kdc[30463](info): set up 2 sockets
Aug 11 16:46:37 dist-test-slave-gsp7 krb5kdc[30463](info): commencing operation
krb5kdc: starting...
W20260811 16:46:39.185772 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:39 dist-test-slave-gsp7 krb5kdc[30463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:39.313097 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39881
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:39.396425 30480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:39.396704 30480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:39.396746 30480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:39.397971 30480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:39.398051 30480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:39.398075 30480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:39.398097 30480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:39.398128 30480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:39.399631 30480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39881
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:39.399924 30480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:39.400174 30480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:39.405464 30486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:39.405458 30488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:39.405521 30490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:39.405786 30480 server_base.cc:1034] running on GCE node
I20260811 16:46:39.406060 30480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:39.406360 30480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:39.407538 30480 hybrid_clock.cc:648] HybridClock initialized: now 1786466799407516 us; error 44 us; skew 500 ppm
Aug 11 16:46:39 dist-test-slave-gsp7 krb5kdc[30463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466799, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:39.418460 30480 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:39.419030 30480 webserver.cc:460] Webserver started at http://127.0.0.1:34711/ using document root <none> and password file <none>
I20260811 16:46:39.419270 30480 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:39.419340 30480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:39.419498 30480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:39.420637 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "56a44046932144c2b5cd7d6ab6fad7ea"
format_stamp: "Formatted at 2026-08-11 16:46:39 on dist-test-slave-gsp7"
server_key: "9e4f631c93af0f3d1f00823dba6d0e3d"
server_key_iv: "8abdd70d0fe9118624153c6e617d90c1"
server_key_version: "encryptionkey@0"
I20260811 16:46:39.421037 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "56a44046932144c2b5cd7d6ab6fad7ea"
format_stamp: "Formatted at 2026-08-11 16:46:39 on dist-test-slave-gsp7"
server_key: "9e4f631c93af0f3d1f00823dba6d0e3d"
server_key_iv: "8abdd70d0fe9118624153c6e617d90c1"
server_key_version: "encryptionkey@0"
I20260811 16:46:39.422663 30480 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:39.423484 30510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:39.423707 30480 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:39.423825 30480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "56a44046932144c2b5cd7d6ab6fad7ea"
format_stamp: "Formatted at 2026-08-11 16:46:39 on dist-test-slave-gsp7"
server_key: "9e4f631c93af0f3d1f00823dba6d0e3d"
server_key_iv: "8abdd70d0fe9118624153c6e617d90c1"
server_key_version: "encryptionkey@0"
I20260811 16:46:39.423900 30480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:39.439744 30480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:39.442198 30480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:39.442370 30480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:39.446846 30480 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39881
I20260811 16:46:39.446892 30587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39881 every 8 connection(s)
I20260811 16:46:39.447270 30480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:39.448160 30588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:39.449203 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30480
I20260811 16:46:39.449365 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:39.449580 28393 external_mini_cluster.cc:1428] Setting key b4654936b9852517352aa81790472417
I20260811 16:46:39.451651 30588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea: Bootstrap starting.
I20260811 16:46:39.452329 30588 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:39.452668 30588 log.cc:824] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:39.453416 30588 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea: No bootstrap required, opened a new log
I20260811 16:46:39.455221 30591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:39.450170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53035 (local address 127.0.0.1:39881)
0811 16:46:39.450366 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:39.450376 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:39.450414 (+ 38us) server_negotiation.cc:407] Connection header received
0811 16:46:39.450853 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:39.450860 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:39.450907 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:39.451061 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:39.451309 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:39.452285 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:39.453211 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:39.453712 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:39.453828 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:39.454586 (+ 758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:39.454590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:39.454590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:39.454767 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:39.454803 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:39.454814 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:39.454894 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:39.454978 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:46:39.455047 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":84,"threads_started":1}
I20260811 16:46:39.455502 30588 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a44046932144c2b5cd7d6ab6fad7ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39881 } }
I20260811 16:46:39.455682 30588 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:39.455732 30588 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a44046932144c2b5cd7d6ab6fad7ea, State: Initialized, Role: FOLLOWER
I20260811 16:46:39.455857 30588 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a44046932144c2b5cd7d6ab6fad7ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39881 } }
I20260811 16:46:39.455942 30588 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:39.455979 30588 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:39.456010 30588 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:39.456327 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:39.456769 30588 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a44046932144c2b5cd7d6ab6fad7ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39881 } }
I20260811 16:46:39.456897 30588 leader_election.cc:302] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56a44046932144c2b5cd7d6ab6fad7ea; no voters:
I20260811 16:46:39.457070 30588 leader_election.cc:288] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:39.457135 30594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:39.457327 30594 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [term 1 LEADER]: Becoming Leader. State: Replica: 56a44046932144c2b5cd7d6ab6fad7ea, State: Running, Role: LEADER
I20260811 16:46:39.457338 30588 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:39.458205 30594 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a44046932144c2b5cd7d6ab6fad7ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39881 } }
I20260811 16:46:39.458859 30598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56a44046932144c2b5cd7d6ab6fad7ea. Latest consensus state: current_term: 1 leader_uuid: "56a44046932144c2b5cd7d6ab6fad7ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a44046932144c2b5cd7d6ab6fad7ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39881 } } }
I20260811 16:46:39.459471 30598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [sys.catalog]: This master's current role is: LEADER
W20260811 16:46:39.459578 30623 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:46:39.459618 30623 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:46:39.459000 30600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56a44046932144c2b5cd7d6ab6fad7ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a44046932144c2b5cd7d6ab6fad7ea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39881 } } }
I20260811 16:46:39.459676 30600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:39.459825 30628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:39.460040 30628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:39.461563 30591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:39.458006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38321 (local address 127.0.0.1:39881)
0811 16:46:39.458046 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:39.458048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:39.458178 (+ 130us) server_negotiation.cc:407] Connection header received
0811 16:46:39.458276 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:39.458277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:39.458288 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:39.458319 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:39.458524 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:39.459241 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:39.460259 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:39.460480 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:39.460566 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:39.461285 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:39.461286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:39.461286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:39.461290 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:39.461305 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:39.461309 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:39.461357 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:39.461418 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 16:46:39.461442 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:46:39.461658 30628 catalog_manager.cc:1347] Generated new cluster ID: 148f2a17c62d4b6d9291d1bb7be90690
I20260811 16:46:39.461700 30628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:39.468266 30628 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:39.468818 30628 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:39.477631 30628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56a44046932144c2b5cd7d6ab6fad7ea: Generated new TSK 0
I20260811 16:46:39.477849 30628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:39.484601 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30480
2026-08-11T16:46:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1580 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:39 dist-test-slave-gsp7 krb5kdc[30634](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:39 dist-test-slave-gsp7 krb5kdc[30634](info): set up 2 sockets
Aug 11 16:46:39 dist-test-slave-gsp7 krb5kdc[30634](info): commencing operation
krb5kdc: starting...
W20260811 16:46:40.771286 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:40 dist-test-slave-gsp7 krb5kdc[30634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466800, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:40.904664 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40387
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:40.990729 30656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:40.990981 30656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:40.991030 30656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:40.992300 30656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:40.992374 30656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:40.992403 30656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:40.992434 30656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:40.992461 30656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:40.994051 30656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:40.994333 30656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:40.994576 30656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:40.999476 30665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:40.999480 30668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:40.999635 30656 server_base.cc:1034] running on GCE node
W20260811 16:46:40.999481 30666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:41.000072 30656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:41.000372 30656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:41.001550 30656 hybrid_clock.cc:648] HybridClock initialized: now 1786466801001537 us; error 28 us; skew 500 ppm
Aug 11 16:46:41 dist-test-slave-gsp7 krb5kdc[30634](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466801, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:41.004081 30656 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:41.004482 30656 webserver.cc:460] Webserver started at http://127.0.0.1:40141/ using document root <none> and password file <none>
I20260811 16:46:41.004662 30656 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:41.004704 30656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:41.004792 30656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:41.005885 30656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "d08a63b8866848469cc585a9ac2b1e03"
format_stamp: "Formatted at 2026-08-11 16:46:41 on dist-test-slave-gsp7"
server_key: "2128528f3faa22e35f06f57295dbc79a"
server_key_iv: "f8ef7919ed44d1d324bb0f1f9e0a05c6"
server_key_version: "encryptionkey@0"
I20260811 16:46:41.006211 30656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "d08a63b8866848469cc585a9ac2b1e03"
format_stamp: "Formatted at 2026-08-11 16:46:41 on dist-test-slave-gsp7"
server_key: "2128528f3faa22e35f06f57295dbc79a"
server_key_iv: "f8ef7919ed44d1d324bb0f1f9e0a05c6"
server_key_version: "encryptionkey@0"
I20260811 16:46:41.007647 30656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:46:41.008420 30679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:41.008738 30656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:41.008821 30656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "d08a63b8866848469cc585a9ac2b1e03"
format_stamp: "Formatted at 2026-08-11 16:46:41 on dist-test-slave-gsp7"
server_key: "2128528f3faa22e35f06f57295dbc79a"
server_key_iv: "f8ef7919ed44d1d324bb0f1f9e0a05c6"
server_key_version: "encryptionkey@0"
I20260811 16:46:41.008874 30656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:41.012229 30656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:41.014516 30656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:41.014633 30656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:41.018800 30656 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40387
I20260811 16:46:41.018864 30784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40387 every 8 connection(s)
I20260811 16:46:41.019177 30656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:41.020071 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30656
I20260811 16:46:41.020198 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:41.020335 30786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:41.020430 28393 external_mini_cluster.cc:1428] Setting key 0b0278a5158008c9752cdf58bff1edb0
I20260811 16:46:41.023207 30790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:41.021035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45209 (local address 127.0.0.1:40387)
0811 16:46:41.021241 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:41.021251 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:41.021291 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:46:41.021818 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:41.021827 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:41.021862 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:41.022030 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:41.022639 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:41.022643 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:41.022643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:41.022648 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:41.022697 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:41.022712 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:41.022821 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:41.022856 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 16:46:41.023009 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
I20260811 16:46:41.024312 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:41.024323 30786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03: Bootstrap starting.
I20260811 16:46:41.024972 30786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:41.025362 30786 log.cc:824] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:41.026250 30786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03: No bootstrap required, opened a new log
I20260811 16:46:41.026851 30790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:41.025892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45307 (local address 127.0.0.1:40387)
0811 16:46:41.025934 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:41.025936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:41.025947 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:46:41.026021 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:41.026022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:41.026027 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:41.026098 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:41.026644 (+ 546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:41.026646 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:41.026646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:41.026650 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:41.026666 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:41.026670 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:41.026735 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:41.026780 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 16:46:41.026792 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:46:41.028285 30786 raft_consensus.cc:348] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08a63b8866848469cc585a9ac2b1e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40387 } }
I20260811 16:46:41.028424 30786 raft_consensus.cc:374] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:41.028450 30786 raft_consensus.cc:729] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08a63b8866848469cc585a9ac2b1e03, State: Initialized, Role: FOLLOWER
I20260811 16:46:41.028589 30786 consensus_queue.cc:260] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08a63b8866848469cc585a9ac2b1e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40387 } }
I20260811 16:46:41.028671 30786 raft_consensus.cc:388] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:41.028728 30786 raft_consensus.cc:482] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:41.028779 30786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:41.029357 30786 raft_consensus.cc:504] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08a63b8866848469cc585a9ac2b1e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40387 } }
I20260811 16:46:41.029446 30786 leader_election.cc:302] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d08a63b8866848469cc585a9ac2b1e03; no voters:
I20260811 16:46:41.029675 30786 leader_election.cc:288] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:41.029785 30798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:41.029963 30798 raft_consensus.cc:686] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [term 1 LEADER]: Becoming Leader. State: Replica: d08a63b8866848469cc585a9ac2b1e03, State: Running, Role: LEADER
I20260811 16:46:41.029968 30786 sys_catalog.cc:564] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:41.030085 30798 consensus_queue.cc:237] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08a63b8866848469cc585a9ac2b1e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40387 } }
I20260811 16:46:41.030529 30799 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d08a63b8866848469cc585a9ac2b1e03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08a63b8866848469cc585a9ac2b1e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40387 } } }
I20260811 16:46:41.030643 30801 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d08a63b8866848469cc585a9ac2b1e03. Latest consensus state: current_term: 1 leader_uuid: "d08a63b8866848469cc585a9ac2b1e03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08a63b8866848469cc585a9ac2b1e03" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40387 } } }
I20260811 16:46:41.030738 30801 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:41.030726 30799 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:41.031067 30816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:41.031625 30816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:41.033145 30816 catalog_manager.cc:1347] Generated new cluster ID: 86f5fcee11354e11ba07891b5543b482
I20260811 16:46:41.033196 30816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:41.059899 30816 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:41.060142 30816 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:41.071566 30816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d08a63b8866848469cc585a9ac2b1e03: Generated new TSK 0
I20260811 16:46:41.071807 30816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:41.077836 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30656
2026-08-11T16:46:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1587 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:41 dist-test-slave-gsp7 krb5kdc[30834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:41 dist-test-slave-gsp7 krb5kdc[30834](info): set up 2 sockets
Aug 11 16:46:41 dist-test-slave-gsp7 krb5kdc[30834](info): commencing operation
krb5kdc: starting...
W20260811 16:46:42.370779 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:42 dist-test-slave-gsp7 krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:42.499873 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40137
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:42.584542 30855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:42.584832 30855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:42.584877 30855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:42.586171 30855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:42.586258 30855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:42.586283 30855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:42.586305 30855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:42.586338 30855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:42.587939 30855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40137
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:42.588261 30855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:42.588517 30855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:42.593833 30868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:42.593834 30871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:42.593835 30869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:42.594121 30855 server_base.cc:1034] running on GCE node
I20260811 16:46:42.594362 30855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:42.594667 30855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:42.595857 30855 hybrid_clock.cc:648] HybridClock initialized: now 1786466802595851 us; error 56 us; skew 500 ppm
Aug 11 16:46:42 dist-test-slave-gsp7 krb5kdc[30834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466802, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:42.598896 30855 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:42.599435 30855 webserver.cc:460] Webserver started at http://127.0.0.1:38407/ using document root <none> and password file <none>
I20260811 16:46:42.599673 30855 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:42.599722 30855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:42.599864 30855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:42.600978 30855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "1dfc2e1532f2406cbca25183eeb5e359"
format_stamp: "Formatted at 2026-08-11 16:46:42 on dist-test-slave-gsp7"
server_key: "897e77c429e6f95d47f5a8712fc16a4b"
server_key_iv: "6b34fbdcbe56ba4c7566dfc566d2885e"
server_key_version: "encryptionkey@0"
I20260811 16:46:42.601382 30855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "1dfc2e1532f2406cbca25183eeb5e359"
format_stamp: "Formatted at 2026-08-11 16:46:42 on dist-test-slave-gsp7"
server_key: "897e77c429e6f95d47f5a8712fc16a4b"
server_key_iv: "6b34fbdcbe56ba4c7566dfc566d2885e"
server_key_version: "encryptionkey@0"
I20260811 16:46:42.602891 30855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:42.603754 30880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:42.603922 30855 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:42.604049 30855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "1dfc2e1532f2406cbca25183eeb5e359"
format_stamp: "Formatted at 2026-08-11 16:46:42 on dist-test-slave-gsp7"
server_key: "897e77c429e6f95d47f5a8712fc16a4b"
server_key_iv: "6b34fbdcbe56ba4c7566dfc566d2885e"
server_key_version: "encryptionkey@0"
I20260811 16:46:42.604130 30855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:42.626680 30855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:42.628931 30855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:42.629132 30855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:42.633652 30855 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40137
I20260811 16:46:42.633692 30966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40137 every 8 connection(s)
I20260811 16:46:42.634114 30855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:42.635012 30967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:42.635872 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 30855
I20260811 16:46:42.635995 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:42.636207 28393 external_mini_cluster.cc:1428] Setting key a3545dee03ccd3776ddf825b05eb4061
I20260811 16:46:42.638556 30967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359: Bootstrap starting.
I20260811 16:46:42.639197 30967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:42.639519 30967 log.cc:824] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:42.640345 30967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359: No bootstrap required, opened a new log
I20260811 16:46:42.642546 30967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfc2e1532f2406cbca25183eeb5e359" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40137 } }
I20260811 16:46:42.642733 30967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:42.642777 30967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dfc2e1532f2406cbca25183eeb5e359, State: Initialized, Role: FOLLOWER
I20260811 16:46:42.642925 30967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfc2e1532f2406cbca25183eeb5e359" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40137 } }
I20260811 16:46:42.643009 30967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:42.643039 30967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
Aug 11 16:46:42 dist-test-slave-gsp7 krb5kdc[30834](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:46:42.643085 30967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:42.643661 30967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfc2e1532f2406cbca25183eeb5e359" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40137 } }
I20260811 16:46:42.643754 30967 leader_election.cc:302] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1dfc2e1532f2406cbca25183eeb5e359; no voters:
I20260811 16:46:42.643953 30967 leader_election.cc:288] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:42.644034 30976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:42.644260 30967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:42.644663 30976 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [term 1 LEADER]: Becoming Leader. State: Replica: 1dfc2e1532f2406cbca25183eeb5e359, State: Running, Role: LEADER
I20260811 16:46:42.645601 30976 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfc2e1532f2406cbca25183eeb5e359" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40137 } }
I20260811 16:46:42.647082 30978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1dfc2e1532f2406cbca25183eeb5e359" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfc2e1532f2406cbca25183eeb5e359" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40137 } } }
I20260811 16:46:42.647186 30978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:42.647471 30998 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:42.647665 30980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dfc2e1532f2406cbca25183eeb5e359. Latest consensus state: current_term: 1 leader_uuid: "1dfc2e1532f2406cbca25183eeb5e359" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfc2e1532f2406cbca25183eeb5e359" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40137 } } }
I20260811 16:46:42.647840 30980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:42.647917 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:42.636811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:48569 (local address 127.0.0.1:40137)
0811 16:46:42.636997 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:42.637005 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:42.637042 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:46:42.637494 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:42.637500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:42.637593 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:42.637711 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:42.638551 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:42.639549 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:42.640355 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:42.640808 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:42.640936 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:42.643608 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:42.643613 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:42.643613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:42.643629 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:42.645573 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:42.646159 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:42.646162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:42.646162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:42.646254 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:42.646502 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:42.646504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:42.646504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:42.646842 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:42.647008 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:42.647532 (+ 524us) server_negotiation.cc:299] Negotiation successful
0811 16:46:42.647656 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260811 16:46:42.648070 30998 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:42.649993 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:42.651051 30998 catalog_manager.cc:1347] Generated new cluster ID: b5a24d0ddd4743a7befd1f68e8bdd53f
I20260811 16:46:42.651120 30998 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:42.659392 30970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:42.651722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:50239 (local address 127.0.0.1:40137)
0811 16:46:42.651762 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:42.651764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:42.651777 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:46:42.651853 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:42.651854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:42.651864 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:42.651930 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:42.652528 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:42.653300 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:42.654338 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:42.654686 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:42.654768 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:42.656258 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:42.656260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:42.656260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:42.656268 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:42.657962 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:42.658396 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:42.658397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:42.658398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:42.658466 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:42.658708 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:42.658709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:42.658710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:42.658850 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:42.658955 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:42.659101 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 16:46:42.659175 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:46:42.665154 30998 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:42.665786 30998 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:42.673985 30998 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1dfc2e1532f2406cbca25183eeb5e359: Generated new TSK 0
I20260811 16:46:42.674234 30998 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:42.680613 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 30855
W20260811 16:46:42.698122 30832 connection.cc:535] client connection to 127.0.0.1:40137 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40137): Connection reset by peer (error 104)
2026-08-11T16:46:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:42 dist-test-slave-gsp7 krb5kdc[31018](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:42 dist-test-slave-gsp7 krb5kdc[31018](info): set up 2 sockets
Aug 11 16:46:42 dist-test-slave-gsp7 krb5kdc[31018](info): commencing operation
krb5kdc: starting...
W20260811 16:46:43.963994 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:44 dist-test-slave-gsp7 krb5kdc[31018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466804, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:44.094749 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34837
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:44.180007 31036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:44.180322 31036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:44.180363 31036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:44.181576 31036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:44.181648 31036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:44.181672 31036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:44.181694 31036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:44.181721 31036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:44.183240 31036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:44.183563 31036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:44.183825 31036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:44.189004 31043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:44.189127 31044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:44.189337 31036 server_base.cc:1034] running on GCE node
W20260811 16:46:44.189428 31047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:44.189720 31036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:44.190052 31036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:44.191210 31036 hybrid_clock.cc:648] HybridClock initialized: now 1786466804191184 us; error 39 us; skew 500 ppm
Aug 11 16:46:44 dist-test-slave-gsp7 krb5kdc[31018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466804, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:44.193921 31036 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:44.194424 31036 webserver.cc:460] Webserver started at http://127.0.0.1:41655/ using document root <none> and password file <none>
I20260811 16:46:44.194656 31036 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:44.194723 31036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:44.194872 31036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:44.196020 31036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "2e75fa4ca1954aada37dd245fdbf50ef"
format_stamp: "Formatted at 2026-08-11 16:46:44 on dist-test-slave-gsp7"
server_key: "39218b0052652d6895ac098f67526702"
server_key_iv: "c8115c7db07aacbd7d5e5e16f52c89cf"
server_key_version: "encryptionkey@0"
I20260811 16:46:44.196410 31036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "2e75fa4ca1954aada37dd245fdbf50ef"
format_stamp: "Formatted at 2026-08-11 16:46:44 on dist-test-slave-gsp7"
server_key: "39218b0052652d6895ac098f67526702"
server_key_iv: "c8115c7db07aacbd7d5e5e16f52c89cf"
server_key_version: "encryptionkey@0"
I20260811 16:46:44.197844 31036 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:44.198614 31056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:44.198797 31036 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:46:44.198909 31036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "2e75fa4ca1954aada37dd245fdbf50ef"
format_stamp: "Formatted at 2026-08-11 16:46:44 on dist-test-slave-gsp7"
server_key: "39218b0052652d6895ac098f67526702"
server_key_iv: "c8115c7db07aacbd7d5e5e16f52c89cf"
server_key_version: "encryptionkey@0"
I20260811 16:46:44.198987 31036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:44.225039 31036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:44.227620 31036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:44.227797 31036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:44.232309 31036 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34837
I20260811 16:46:44.232352 31144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34837 every 8 connection(s)
I20260811 16:46:44.232760 31036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:44.233759 31146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:44.236073 31146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef: Bootstrap starting.
I20260811 16:46:44.236634 31146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:44.236876 31146 log.cc:824] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:44.237656 31146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef: No bootstrap required, opened a new log
I20260811 16:46:44.239250 31146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e75fa4ca1954aada37dd245fdbf50ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34837 } }
I20260811 16:46:44.239394 31146 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:44.239418 31146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e75fa4ca1954aada37dd245fdbf50ef, State: Initialized, Role: FOLLOWER
I20260811 16:46:44.239531 31146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e75fa4ca1954aada37dd245fdbf50ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34837 } }
I20260811 16:46:44.239588 31146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:44.239609 31146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:44.239636 31146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:44.240139 31146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e75fa4ca1954aada37dd245fdbf50ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34837 } }
I20260811 16:46:44.240227 31146 leader_election.cc:302] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e75fa4ca1954aada37dd245fdbf50ef; no voters:
I20260811 16:46:44.240358 31146 leader_election.cc:288] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:44.240439 31160 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:44.240617 31160 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [term 1 LEADER]: Becoming Leader. State: Replica: 2e75fa4ca1954aada37dd245fdbf50ef, State: Running, Role: LEADER
I20260811 16:46:44.240670 31146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:44.240732 31160 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e75fa4ca1954aada37dd245fdbf50ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34837 } }
I20260811 16:46:44.241097 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31036
I20260811 16:46:44.241240 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:44.241505 28393 external_mini_cluster.cc:1428] Setting key 130ba12a784f0742bf8623a54d784d28
I20260811 16:46:44.241788 31161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e75fa4ca1954aada37dd245fdbf50ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e75fa4ca1954aada37dd245fdbf50ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34837 } } }
I20260811 16:46:44.241837 31162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e75fa4ca1954aada37dd245fdbf50ef. Latest consensus state: current_term: 1 leader_uuid: "2e75fa4ca1954aada37dd245fdbf50ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e75fa4ca1954aada37dd245fdbf50ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34837 } } }
I20260811 16:46:44.241894 31161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:44.241928 31162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef [sys.catalog]: This master's current role is: LEADER
W20260811 16:46:44.242740 31188 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:46:44.242800 31188 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:46:44.242846 31182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:44.243040 31182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:44.244755 31182 catalog_manager.cc:1347] Generated new cluster ID: 24a117eac6aa4cb5bb4f3cf6439f8d8e
I20260811 16:46:44.244813 31182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:44.248025 31191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:44.242286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:45417 (local address 127.0.0.1:34837)
0811 16:46:44.242553 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:44.242563 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:44.242597 (+ 34us) server_negotiation.cc:407] Connection header received
0811 16:46:44.242723 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:44.242730 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:44.242795 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:44.242950 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:44.243210 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:44.244495 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:44.245686 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:44.246314 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:44.246415 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:44.247270 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:44.247274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:44.247275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:44.247492 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:44.247531 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:44.247545 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:44.247626 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:44.247757 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 16:46:44.247787 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":75,"threads_started":1}
I20260811 16:46:44.249382 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:44.257413 31191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:44.251242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:53983 (local address 127.0.0.1:34837)
0811 16:46:44.251312 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:44.251314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:44.253705 (+ 2391us) server_negotiation.cc:407] Connection header received
0811 16:46:44.253779 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:44.253780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:44.253790 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:44.253844 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:44.254084 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:44.254895 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:44.255907 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:44.256250 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:44.256335 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:44.257107 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:44.257109 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:44.257109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:44.257115 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:44.257134 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:44.257140 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:44.257208 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:44.257274 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 16:46:44.257290 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 16:46:44.263865 31182 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:44.264643 31182 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:44.271099 31182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e75fa4ca1954aada37dd245fdbf50ef: Generated new TSK 0
I20260811 16:46:44.271320 31182 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:44.273424 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31036
W20260811 16:46:44.299647 31016 connection.cc:535] client connection to 127.0.0.1:34837 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34837): Connection reset by peer (error 104)
2026-08-11T16:46:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:44 dist-test-slave-gsp7 krb5kdc[31215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:44 dist-test-slave-gsp7 krb5kdc[31215](info): set up 2 sockets
Aug 11 16:46:44 dist-test-slave-gsp7 krb5kdc[31215](info): commencing operation
krb5kdc: starting...
W20260811 16:46:45.560874 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:45 dist-test-slave-gsp7 krb5kdc[31215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466805, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:45.687922 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42081
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:45.771456 31231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:45.771673 31231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:45.771696 31231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:45.772812 31231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:45.772850 31231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:45.772866 31231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:45.772877 31231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:45.772889 31231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:45.774461 31231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:45.774731 31231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:45.774999 31231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:45.779975 31240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:45.779991 31237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:45.779991 31238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:45.780009 31231 server_base.cc:1034] running on GCE node
I20260811 16:46:45.780494 31231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:45.780813 31231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:45.781982 31231 hybrid_clock.cc:648] HybridClock initialized: now 1786466805781951 us; error 60 us; skew 500 ppm
Aug 11 16:46:45 dist-test-slave-gsp7 krb5kdc[31215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466805, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:45.788448 31231 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:45.788892 31231 webserver.cc:460] Webserver started at http://127.0.0.1:46603/ using document root <none> and password file <none>
I20260811 16:46:45.789093 31231 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:45.789136 31231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:45.789227 31231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:45.790386 31231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "989f252cf0f545c98e29c40770ac3c20"
format_stamp: "Formatted at 2026-08-11 16:46:45 on dist-test-slave-gsp7"
server_key: "fd873104dddfa1caae0546285e8544a0"
server_key_iv: "95a46dab9559bc6a0269e07d1b289428"
server_key_version: "encryptionkey@0"
I20260811 16:46:45.790714 31231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "989f252cf0f545c98e29c40770ac3c20"
format_stamp: "Formatted at 2026-08-11 16:46:45 on dist-test-slave-gsp7"
server_key: "fd873104dddfa1caae0546285e8544a0"
server_key_iv: "95a46dab9559bc6a0269e07d1b289428"
server_key_version: "encryptionkey@0"
I20260811 16:46:45.792035 31231 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 16:46:45.792739 31249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:45.792914 31231 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:46:45.793020 31231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "989f252cf0f545c98e29c40770ac3c20"
format_stamp: "Formatted at 2026-08-11 16:46:45 on dist-test-slave-gsp7"
server_key: "fd873104dddfa1caae0546285e8544a0"
server_key_iv: "95a46dab9559bc6a0269e07d1b289428"
server_key_version: "encryptionkey@0"
I20260811 16:46:45.793080 31231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:45.796373 31231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:45.798672 31231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:45.798784 31231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:45.802703 31231 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42081
I20260811 16:46:45.802772 31329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42081 every 8 connection(s)
I20260811 16:46:45.803104 31231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:45.803476 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31231
I20260811 16:46:45.803632 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:45.803860 28393 external_mini_cluster.cc:1428] Setting key d7ad1b2ef7f58be0842f6c0274af6e8a
I20260811 16:46:45.804406 31332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:45.806667 31336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:45.804427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:48693 (local address 127.0.0.1:42081)
0811 16:46:45.804665 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:45.804674 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:45.804705 (+ 31us) server_negotiation.cc:407] Connection header received
0811 16:46:45.805230 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:45.805240 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:45.805274 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:45.805427 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:45.806148 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:45.806151 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:45.806152 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:45.806156 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:45.806201 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:45.806215 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:45.806299 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:45.806422 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 16:46:45.806469 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":107,"threads_started":1}
I20260811 16:46:45.807781 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:45.808048 31332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20: Bootstrap starting.
I20260811 16:46:45.808823 31332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:45.809232 31332 log.cc:824] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:45.810179 31332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20: No bootstrap required, opened a new log
I20260811 16:46:45.810813 31336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:45.809615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:58133 (local address 127.0.0.1:42081)
0811 16:46:45.809679 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:45.809681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:45.809847 (+ 166us) server_negotiation.cc:407] Connection header received
0811 16:46:45.809922 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:45.809923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:45.809929 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:45.810004 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:45.810606 (+ 602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:45.810607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:45.810608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:45.810612 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:45.810627 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:45.810632 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:45.810704 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:45.810739 (+ 35us) server_negotiation.cc:299] Negotiation successful
0811 16:46:45.810751 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:46:45.812252 31332 raft_consensus.cc:348] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f252cf0f545c98e29c40770ac3c20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42081 } }
I20260811 16:46:45.812424 31332 raft_consensus.cc:374] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:45.812472 31332 raft_consensus.cc:729] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989f252cf0f545c98e29c40770ac3c20, State: Initialized, Role: FOLLOWER
I20260811 16:46:45.812601 31332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f252cf0f545c98e29c40770ac3c20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42081 } }
I20260811 16:46:45.812721 31332 raft_consensus.cc:388] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:45.812767 31332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:45.812821 31332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:45.813392 31332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f252cf0f545c98e29c40770ac3c20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42081 } }
I20260811 16:46:45.813534 31332 leader_election.cc:302] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 989f252cf0f545c98e29c40770ac3c20; no voters:
I20260811 16:46:45.813689 31332 leader_election.cc:288] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:45.813772 31350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:45.813971 31350 raft_consensus.cc:686] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [term 1 LEADER]: Becoming Leader. State: Replica: 989f252cf0f545c98e29c40770ac3c20, State: Running, Role: LEADER
I20260811 16:46:45.814007 31332 sys_catalog.cc:564] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:45.814110 31350 consensus_queue.cc:237] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f252cf0f545c98e29c40770ac3c20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42081 } }
I20260811 16:46:45.814512 31355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 989f252cf0f545c98e29c40770ac3c20. Latest consensus state: current_term: 1 leader_uuid: "989f252cf0f545c98e29c40770ac3c20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f252cf0f545c98e29c40770ac3c20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42081 } } }
I20260811 16:46:45.814548 31353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "989f252cf0f545c98e29c40770ac3c20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f252cf0f545c98e29c40770ac3c20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42081 } } }
I20260811 16:46:45.814710 31353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:45.814697 31355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:45.815147 31371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:45.815620 31371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:45.817127 31371 catalog_manager.cc:1347] Generated new cluster ID: 953a634baf0b4301b40022647f75aa67
I20260811 16:46:45.817183 31371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:45.826905 31371 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:45.827100 31371 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:45.832835 31371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 989f252cf0f545c98e29c40770ac3c20: Generated new TSK 0
I20260811 16:46:45.833069 31371 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:45.843815 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31231
2026-08-11T16:46:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1558 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:45 dist-test-slave-gsp7 krb5kdc[31392](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:45 dist-test-slave-gsp7 krb5kdc[31392](info): set up 2 sockets
Aug 11 16:46:45 dist-test-slave-gsp7 krb5kdc[31392](info): commencing operation
krb5kdc: starting...
W20260811 16:46:47.122195 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:47 dist-test-slave-gsp7 krb5kdc[31392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:47.247874 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36629
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:47.331384 31411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:47.331646 31411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:47.331686 31411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:47.332808 31411 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:47.332883 31411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:47.332909 31411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:47.332938 31411 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:47.332970 31411 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:47.334481 31411 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36629
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:47.334758 31411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:47.334997 31411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:47.339871 31417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:47.339866 31418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:47.339895 31420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:47.340134 31411 server_base.cc:1034] running on GCE node
I20260811 16:46:47.340372 31411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:47.340617 31411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:47.341756 31411 hybrid_clock.cc:648] HybridClock initialized: now 1786466807341741 us; error 48 us; skew 500 ppm
Aug 11 16:46:47 dist-test-slave-gsp7 krb5kdc[31392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466807, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:47.344349 31411 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:47.344899 31411 webserver.cc:460] Webserver started at http://127.0.0.1:46543/ using document root <none> and password file <none>
I20260811 16:46:47.345184 31411 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:47.345259 31411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:47.345408 31411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:47.346505 31411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "09875bc084f342d09b5ab037ddb0726a"
format_stamp: "Formatted at 2026-08-11 16:46:47 on dist-test-slave-gsp7"
server_key: "7a76ce6420d0dda2a99c1a4215bd07b6"
server_key_iv: "c7c465d3b7e8296ff0325e6a607cce9a"
server_key_version: "encryptionkey@0"
I20260811 16:46:47.346882 31411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "09875bc084f342d09b5ab037ddb0726a"
format_stamp: "Formatted at 2026-08-11 16:46:47 on dist-test-slave-gsp7"
server_key: "7a76ce6420d0dda2a99c1a4215bd07b6"
server_key_iv: "c7c465d3b7e8296ff0325e6a607cce9a"
server_key_version: "encryptionkey@0"
I20260811 16:46:47.348320 31411 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:47.349123 31430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:47.349323 31411 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:47.349437 31411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "09875bc084f342d09b5ab037ddb0726a"
format_stamp: "Formatted at 2026-08-11 16:46:47 on dist-test-slave-gsp7"
server_key: "7a76ce6420d0dda2a99c1a4215bd07b6"
server_key_iv: "c7c465d3b7e8296ff0325e6a607cce9a"
server_key_version: "encryptionkey@0"
I20260811 16:46:47.349540 31411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:47.368137 31411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:47.370559 31411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:47.370756 31411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:47.375192 31411 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36629
I20260811 16:46:47.375237 31519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36629 every 8 connection(s)
I20260811 16:46:47.375639 31411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:47.376547 31520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:47.378893 31520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a: Bootstrap starting.
I20260811 16:46:47.379472 31520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:47.379722 31520 log.cc:824] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:47.380430 31520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a: No bootstrap required, opened a new log
I20260811 16:46:47.382210 31520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09875bc084f342d09b5ab037ddb0726a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36629 } }
I20260811 16:46:47.382364 31520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:47.382388 31520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09875bc084f342d09b5ab037ddb0726a, State: Initialized, Role: FOLLOWER
I20260811 16:46:47.382544 31520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09875bc084f342d09b5ab037ddb0726a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36629 } }
I20260811 16:46:47.382632 31520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:47.382656 31520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:47.382686 31520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:47.383211 31520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09875bc084f342d09b5ab037ddb0726a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36629 } }
I20260811 16:46:47.383301 31520 leader_election.cc:302] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09875bc084f342d09b5ab037ddb0726a; no voters:
I20260811 16:46:47.383436 31520 leader_election.cc:288] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:47.383517 31524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:47.383715 31524 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [term 1 LEADER]: Becoming Leader. State: Replica: 09875bc084f342d09b5ab037ddb0726a, State: Running, Role: LEADER
I20260811 16:46:47.383757 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31411
I20260811 16:46:47.383860 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:47.383714 31520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:47.383958 31524 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09875bc084f342d09b5ab037ddb0726a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36629 } }
I20260811 16:46:47.384074 28393 external_mini_cluster.cc:1428] Setting key 505ce44e0afaf78883b630683f972d9c
I20260811 16:46:47.384532 31528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09875bc084f342d09b5ab037ddb0726a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09875bc084f342d09b5ab037ddb0726a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36629 } } }
I20260811 16:46:47.384687 31528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:47.385159 31549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:47.385195 31532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09875bc084f342d09b5ab037ddb0726a. Latest consensus state: current_term: 1 leader_uuid: "09875bc084f342d09b5ab037ddb0726a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09875bc084f342d09b5ab037ddb0726a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36629 } } }
I20260811 16:46:47.385335 31532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:47.385751 31549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:47.387594 31549 catalog_manager.cc:1347] Generated new cluster ID: fa9c1f44e5e14b49b5b79ff2b49caaf2
I20260811 16:46:47.387655 31549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:46:47 dist-test-slave-gsp7 krb5kdc[31392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 16:46:47.395826 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:47.384820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:54063 (local address 127.0.0.1:36629)
0811 16:46:47.385617 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:47.385628 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:47.385667 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:46:47.385799 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:47.385808 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:47.385878 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:47.386786 (+ 908us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:47.386897 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:47.388043 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:47.388858 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:47.389296 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:47.389419 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:47.391847 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:47.391852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:47.391852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:47.391864 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:47.394165 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:47.394592 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:47.394595 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:47.394595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:47.394691 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:47.394934 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:47.394935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:47.394936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:47.395183 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:47.395370 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:47.395498 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 16:46:47.395606 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":79,"threads_started":1}
I20260811 16:46:47.396796 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:47.408277 31547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:47.401803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:58937 (local address 127.0.0.1:36629)
0811 16:46:47.401913 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:47.401916 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:47.402019 (+ 103us) server_negotiation.cc:407] Connection header received
0811 16:46:47.402097 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:47.402098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:47.402108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:47.402158 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:47.402712 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:47.403227 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:47.403938 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:47.404180 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:47.404261 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:47.405533 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:47.405534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:47.405535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:47.405541 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:47.406962 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:47.407342 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:47.407343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:47.407344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:47.407405 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:47.407652 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:47.407653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:47.407653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:47.407766 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:47.407882 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:47.408019 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 16:46:47.408085 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 16:46:47.409006 31549 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:47.409559 31549 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:47.412123 31549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09875bc084f342d09b5ab037ddb0726a: Generated new TSK 0
I20260811 16:46:47.412319 31549 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:47.415934 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31411
W20260811 16:46:47.432082 31388 connection.cc:535] client connection to 127.0.0.1:36629 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36629): Connection reset by peer (error 104)
2026-08-11T16:46:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1573 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:47 dist-test-slave-gsp7 krb5kdc[31570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:47 dist-test-slave-gsp7 krb5kdc[31570](info): set up 2 sockets
Aug 11 16:46:47 dist-test-slave-gsp7 krb5kdc[31570](info): commencing operation
krb5kdc: starting...
W20260811 16:46:48.697906 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.252s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:48 dist-test-slave-gsp7 krb5kdc[31570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:48.828346 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38359
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:48.911370 31593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:48.911623 31593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:48.911661 31593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:48.912815 31593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:48.912887 31593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:48.912911 31593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:48.912932 31593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:48.912963 31593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:48.914484 31593 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38359
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:48.914775 31593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:48.915035 31593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:48.919905 31601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:48.920059 31603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:48.920222 31599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:48.920228 31593 server_base.cc:1034] running on GCE node
I20260811 16:46:48.920508 31593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:48.920806 31593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:48.921975 31593 hybrid_clock.cc:648] HybridClock initialized: now 1786466808921966 us; error 40 us; skew 500 ppm
Aug 11 16:46:48 dist-test-slave-gsp7 krb5kdc[31570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466808, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:48.924667 31593 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:48.925122 31593 webserver.cc:460] Webserver started at http://127.0.0.1:43267/ using document root <none> and password file <none>
I20260811 16:46:48.925369 31593 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:48.925530 31593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:48.925676 31593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:48.926827 31593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "cdc62643df4949c7a24dfd1bd50344be"
format_stamp: "Formatted at 2026-08-11 16:46:48 on dist-test-slave-gsp7"
server_key: "d75fffeb98c317687c3fa6f1929569dc"
server_key_iv: "e840a23c27103f6815a0f61138f307aa"
server_key_version: "encryptionkey@0"
I20260811 16:46:48.927206 31593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "cdc62643df4949c7a24dfd1bd50344be"
format_stamp: "Formatted at 2026-08-11 16:46:48 on dist-test-slave-gsp7"
server_key: "d75fffeb98c317687c3fa6f1929569dc"
server_key_iv: "e840a23c27103f6815a0f61138f307aa"
server_key_version: "encryptionkey@0"
I20260811 16:46:48.928562 31593 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:48.929301 31615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:48.929458 31593 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:46:48.929636 31593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "cdc62643df4949c7a24dfd1bd50344be"
format_stamp: "Formatted at 2026-08-11 16:46:48 on dist-test-slave-gsp7"
server_key: "d75fffeb98c317687c3fa6f1929569dc"
server_key_iv: "e840a23c27103f6815a0f61138f307aa"
server_key_version: "encryptionkey@0"
I20260811 16:46:48.929713 31593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:48.950004 31593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:48.952328 31593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:48.952502 31593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:48.956899 31593 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38359
I20260811 16:46:48.956934 31701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38359 every 8 connection(s)
I20260811 16:46:48.957309 31593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:48.958209 31704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:48.960552 31704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be: Bootstrap starting.
I20260811 16:46:48.961154 31704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:48.961470 31704 log.cc:824] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:48.962198 31704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be: No bootstrap required, opened a new log
I20260811 16:46:48.963778 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31593
I20260811 16:46:48.963919 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:48.963814 31704 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc62643df4949c7a24dfd1bd50344be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38359 } }
I20260811 16:46:48.964062 31704 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:48.964115 31704 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdc62643df4949c7a24dfd1bd50344be, State: Initialized, Role: FOLLOWER
I20260811 16:46:48.964167 28393 external_mini_cluster.cc:1428] Setting key fd75d5c1b2e93d4256158cdbb8bf43f6
I20260811 16:46:48.964277 31704 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc62643df4949c7a24dfd1bd50344be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38359 } }
I20260811 16:46:48.964378 31704 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:48.964416 31704 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:48.964473 31704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:48.965576 31704 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc62643df4949c7a24dfd1bd50344be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38359 } }
I20260811 16:46:48.965703 31704 leader_election.cc:302] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdc62643df4949c7a24dfd1bd50344be; no voters:
I20260811 16:46:48.965902 31704 leader_election.cc:288] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:48.965934 31711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:48.966061 31711 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [term 1 LEADER]: Becoming Leader. State: Replica: cdc62643df4949c7a24dfd1bd50344be, State: Running, Role: LEADER
I20260811 16:46:48.966214 31711 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc62643df4949c7a24dfd1bd50344be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38359 } }
I20260811 16:46:48.966204 31704 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:48.966629 31715 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdc62643df4949c7a24dfd1bd50344be. Latest consensus state: current_term: 1 leader_uuid: "cdc62643df4949c7a24dfd1bd50344be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc62643df4949c7a24dfd1bd50344be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38359 } } }
I20260811 16:46:48.966768 31715 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:48.967291 31717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:48.967348 31712 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdc62643df4949c7a24dfd1bd50344be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc62643df4949c7a24dfd1bd50344be" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38359 } } }
I20260811 16:46:48.967433 31712 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:48.967818 31717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:48.969527 31717 catalog_manager.cc:1347] Generated new cluster ID: 59c41342ad0740ffb382817fc7940288
I20260811 16:46:48.969576 31717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:48.970467 31709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:48.964771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:60621 (local address 127.0.0.1:38359)
0811 16:46:48.964957 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:48.964964 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:48.964999 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:46:48.965100 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:48.965106 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:48.965147 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:48.965287 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:48.965529 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:48.966804 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:48.967925 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:48.968501 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:48.969590 (+ 1089us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:48.969746 (+ 156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:48.969749 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:48.969749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:48.969931 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:48.969963 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:48.969975 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:48.970074 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:48.970236 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 16:46:48.970264 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":89,"threads_started":1}
I20260811 16:46:48.971448 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:48.976509 31709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:48.972904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:50019 (local address 127.0.0.1:38359)
0811 16:46:48.972941 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:48.972943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:48.973083 (+ 140us) server_negotiation.cc:407] Connection header received
0811 16:46:48.973110 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:48.973111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:48.973124 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:48.973188 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:48.973318 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:48.974091 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:48.975056 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:48.975464 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:48.975542 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:48.976256 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:48.976257 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:48.976258 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:48.976262 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:48.976278 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:48.976283 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:48.976344 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:48.976426 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 16:46:48.976439 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:46:48.980717 31717 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:48.981192 31717 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:48.989012 31717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdc62643df4949c7a24dfd1bd50344be: Generated new TSK 0
I20260811 16:46:48.989212 31717 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:48.994065 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31593
W20260811 16:46:49.010334 31567 connection.cc:535] client connection to 127.0.0.1:38359 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38359): Connection reset by peer (error 104)
2026-08-11T16:46:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1578 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:49 dist-test-slave-gsp7 krb5kdc[31765](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:49 dist-test-slave-gsp7 krb5kdc[31765](info): set up 2 sockets
Aug 11 16:46:49 dist-test-slave-gsp7 krb5kdc[31765](info): commencing operation
krb5kdc: starting...
W20260811 16:46:50.285156 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:50 dist-test-slave-gsp7 krb5kdc[31765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 16:46:50.412307 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44887
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:50.495062 31783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:50.495321 31783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:50.495362 31783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:50.496522 31783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:50.496596 31783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:50.496620 31783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:50.496651 31783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:50.496682 31783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:50.498188 31783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44887
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:50.498481 31783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:50.498735 31783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:50.503971 31795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:50.504050 31796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:50.504263 31798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:50.505309 31783 server_base.cc:1034] running on GCE node
I20260811 16:46:50.505626 31783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:50.505935 31783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:50.507136 31783 hybrid_clock.cc:648] HybridClock initialized: now 1786466810507130 us; error 38 us; skew 500 ppm
Aug 11 16:46:50 dist-test-slave-gsp7 krb5kdc[31765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466810, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:50.509656 31783 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 16:46:50.510156 31783 webserver.cc:460] Webserver started at http://127.0.0.1:46201/ using document root <none> and password file <none>
I20260811 16:46:50.510390 31783 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:50.510461 31783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:50.510600 31783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:50.511699 31783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "a97ed7756ef04878b07a53af470cb88e"
format_stamp: "Formatted at 2026-08-11 16:46:50 on dist-test-slave-gsp7"
server_key: "d3b694fc25f640659e2f6a7b66b46e82"
server_key_iv: "d7f623ae14e7ca741c46f5a7db60d7ef"
server_key_version: "encryptionkey@0"
I20260811 16:46:50.512096 31783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "a97ed7756ef04878b07a53af470cb88e"
format_stamp: "Formatted at 2026-08-11 16:46:50 on dist-test-slave-gsp7"
server_key: "d3b694fc25f640659e2f6a7b66b46e82"
server_key_iv: "d7f623ae14e7ca741c46f5a7db60d7ef"
server_key_version: "encryptionkey@0"
I20260811 16:46:50.513520 31783 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:50.514297 31808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:50.514468 31783 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:50.514581 31783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "a97ed7756ef04878b07a53af470cb88e"
format_stamp: "Formatted at 2026-08-11 16:46:50 on dist-test-slave-gsp7"
server_key: "d3b694fc25f640659e2f6a7b66b46e82"
server_key_iv: "d7f623ae14e7ca741c46f5a7db60d7ef"
server_key_version: "encryptionkey@0"
I20260811 16:46:50.514667 31783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:50.518016 31783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:50.519840 31783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:50.520004 31783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:50.524202 31783 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44887
I20260811 16:46:50.524235 31899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44887 every 8 connection(s)
I20260811 16:46:50.524565 31783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:50.525588 31901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:50.527845 31901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e: Bootstrap starting.
I20260811 16:46:50.527980 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31783
I20260811 16:46:50.528120 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:50.528324 28393 external_mini_cluster.cc:1428] Setting key f99cbed60fdc6a4fb40540514c9e44a8
I20260811 16:46:50.528529 31901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:50.528882 31901 log.cc:824] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:50.529724 31901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e: No bootstrap required, opened a new log
I20260811 16:46:50.530985 31904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:50.528869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:57131 (local address 127.0.0.1:44887)
0811 16:46:50.529182 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:50.529192 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:50.529225 (+ 33us) server_negotiation.cc:407] Connection header received
0811 16:46:50.529744 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:50.529751 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:50.529777 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:50.529942 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:50.530610 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:50.530613 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:50.530613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:50.530617 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:50.530653 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:50.530663 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:50.530737 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:50.530812 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 16:46:50.530845 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":194,"threads_started":1}
I20260811 16:46:50.532019 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:50.532495 31901 raft_consensus.cc:348] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97ed7756ef04878b07a53af470cb88e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44887 } }
I20260811 16:46:50.532655 31901 raft_consensus.cc:374] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:50.532701 31901 raft_consensus.cc:729] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97ed7756ef04878b07a53af470cb88e, State: Initialized, Role: FOLLOWER
I20260811 16:46:50.532820 31901 consensus_queue.cc:260] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97ed7756ef04878b07a53af470cb88e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44887 } }
I20260811 16:46:50.532940 31901 raft_consensus.cc:388] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:50.533001 31901 raft_consensus.cc:482] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:50.533072 31901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:50.533768 31901 raft_consensus.cc:504] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97ed7756ef04878b07a53af470cb88e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44887 } }
I20260811 16:46:50.533890 31901 leader_election.cc:302] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a97ed7756ef04878b07a53af470cb88e; no voters:
I20260811 16:46:50.534078 31901 leader_election.cc:288] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:50.534113 31912 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:50.534336 31912 raft_consensus.cc:686] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [term 1 LEADER]: Becoming Leader. State: Replica: a97ed7756ef04878b07a53af470cb88e, State: Running, Role: LEADER
I20260811 16:46:50.534341 31901 sys_catalog.cc:564] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:50.534511 31912 consensus_queue.cc:237] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97ed7756ef04878b07a53af470cb88e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44887 } }
I20260811 16:46:50.534699 31904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:50.533546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.114:42357 (local address 127.0.0.1:44887)
0811 16:46:50.533587 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:50.533590 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:50.533661 (+ 71us) server_negotiation.cc:407] Connection header received
0811 16:46:50.533727 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:50.533728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:50.533733 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:50.533795 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:50.534407 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:50.534408 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:50.534408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:50.534413 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:50.534427 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:50.534432 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:50.534481 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:50.534627 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 16:46:50.534642 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:46:50.535471 31913 sys_catalog.cc:455] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a97ed7756ef04878b07a53af470cb88e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97ed7756ef04878b07a53af470cb88e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44887 } } }
I20260811 16:46:50.535580 31913 sys_catalog.cc:458] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:50.535820 31928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:50.536194 31914 sys_catalog.cc:455] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a97ed7756ef04878b07a53af470cb88e. Latest consensus state: current_term: 1 leader_uuid: "a97ed7756ef04878b07a53af470cb88e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a97ed7756ef04878b07a53af470cb88e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44887 } } }
I20260811 16:46:50.536281 31914 sys_catalog.cc:458] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:50.536377 31928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:50.538029 31928 catalog_manager.cc:1347] Generated new cluster ID: 3dd02ba4fa184ffa8119963eb3bda939
I20260811 16:46:50.538074 31928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:50.567999 31928 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:50.568229 31928 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:50.573320 31928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a97ed7756ef04878b07a53af470cb88e: Generated new TSK 0
I20260811 16:46:50.573611 31928 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:50.584532 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31783
2026-08-11T16:46:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1583 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:50 dist-test-slave-gsp7 krb5kdc[31940](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:50 dist-test-slave-gsp7 krb5kdc[31940](info): set up 2 sockets
Aug 11 16:46:50 dist-test-slave-gsp7 krb5kdc[31940](info): commencing operation
krb5kdc: starting...
W20260811 16:46:51.851464 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:51 dist-test-slave-gsp7 krb5kdc[31940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:51.990355 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34997
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:36007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:34997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:52.077396 31961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:52.077633 31961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:52.077658 31961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:52.078775 31961 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:52.078814 31961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:52.078830 31961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:52.078841 31961 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:52.078853 31961 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:52.080355 31961 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:36007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:34997
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:34997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:52.080574 31961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:52.080762 31961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:52.085723 31972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:52.085799 31976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:52.085927 31961 server_base.cc:1034] running on GCE node
W20260811 16:46:52.085723 31978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:52.086244 31961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:52.086498 31961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:52.087641 31961 hybrid_clock.cc:648] HybridClock initialized: now 1786466812087618 us; error 40 us; skew 500 ppm
Aug 11 16:46:52 dist-test-slave-gsp7 krb5kdc[31940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466812, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:52.090240 31961 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:52.090718 31961 webserver.cc:460] Webserver started at http://127.27.186.126:39571/ using document root <none> and password file <none>
I20260811 16:46:52.090969 31961 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:52.091015 31961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:52.091182 31961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:52.092229 31961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "9e9be84005d74b9c986f856c4c63bf33"
format_stamp: "Formatted at 2026-08-11 16:46:52 on dist-test-slave-gsp7"
server_key: "371d6a2faaca49b085cd3a1c58ee2d73"
server_key_iv: "4b044cbc7019e9b2a1401278bc363c13"
server_key_version: "encryptionkey@0"
I20260811 16:46:52.092600 31961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "9e9be84005d74b9c986f856c4c63bf33"
format_stamp: "Formatted at 2026-08-11 16:46:52 on dist-test-slave-gsp7"
server_key: "371d6a2faaca49b085cd3a1c58ee2d73"
server_key_iv: "4b044cbc7019e9b2a1401278bc363c13"
server_key_version: "encryptionkey@0"
I20260811 16:46:52.094053 31961 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:52.094885 31998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:52.095089 31961 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:46:52.095191 31961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "9e9be84005d74b9c986f856c4c63bf33"
format_stamp: "Formatted at 2026-08-11 16:46:52 on dist-test-slave-gsp7"
server_key: "371d6a2faaca49b085cd3a1c58ee2d73"
server_key_iv: "4b044cbc7019e9b2a1401278bc363c13"
server_key_version: "encryptionkey@0"
I20260811 16:46:52.095268 31961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:52.120925 31961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:52.122954 31961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:52.123170 31961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:52.127534 31961 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:34997
I20260811 16:46:52.127599 32082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:34997 every 8 connection(s)
I20260811 16:46:52.127988 31961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:52.128902 32083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:52.131274 32083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33: Bootstrap starting.
I20260811 16:46:52.131878 32083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:52.132176 32083 log.cc:824] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:52.132992 32083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33: No bootstrap required, opened a new log
I20260811 16:46:52.134683 32083 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e9be84005d74b9c986f856c4c63bf33" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34997 } }
I20260811 16:46:52.134830 32083 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:52.134853 32083 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e9be84005d74b9c986f856c4c63bf33, State: Initialized, Role: FOLLOWER
I20260811 16:46:52.135037 32083 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e9be84005d74b9c986f856c4c63bf33" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34997 } }
I20260811 16:46:52.135103 32083 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:52.135125 32083 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:52.135197 32083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:52.136076 32083 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e9be84005d74b9c986f856c4c63bf33" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34997 } }
I20260811 16:46:52.136194 32083 leader_election.cc:302] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e9be84005d74b9c986f856c4c63bf33; no voters:
I20260811 16:46:52.136392 32083 leader_election.cc:288] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:52.136439 32088 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:52.136622 32088 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [term 1 LEADER]: Becoming Leader. State: Replica: 9e9be84005d74b9c986f856c4c63bf33, State: Running, Role: LEADER
I20260811 16:46:52.136703 32083 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:52.136783 32088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e9be84005d74b9c986f856c4c63bf33" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34997 } }
I20260811 16:46:52.137285 32089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e9be84005d74b9c986f856c4c63bf33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e9be84005d74b9c986f856c4c63bf33" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34997 } } }
I20260811 16:46:52.137300 32090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e9be84005d74b9c986f856c4c63bf33. Latest consensus state: current_term: 1 leader_uuid: "9e9be84005d74b9c986f856c4c63bf33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e9be84005d74b9c986f856c4c63bf33" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 34997 } } }
I20260811 16:46:52.137506 32090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:52.137498 32089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:52.137801 32099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:52.137984 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 31961
I20260811 16:46:52.138132 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:52.138325 28393 external_mini_cluster.cc:1428] Setting key 1d37400580e0639aafe7103672c40759
I20260811 16:46:52.138332 32099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:52.140163 32099 catalog_manager.cc:1347] Generated new cluster ID: ee5cbfc5d98245208ebd65c70eebaa2b
I20260811 16:46:52.140220 32099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:46:52 dist-test-slave-gsp7 krb5kdc[31940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:52.147670 32099 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:52.148377 32099 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:52.150986 32099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e9be84005d74b9c986f856c4c63bf33: Generated new TSK 0
I20260811 16:46:52.151161 32099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:52.151175 32116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:52.138978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57249 (local address 127.27.186.126:34997)
0811 16:46:52.139515 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:52.139525 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:52.139561 (+ 36us) server_negotiation.cc:407] Connection header received
0811 16:46:52.139669 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:52.139675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:52.139761 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:52.139910 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:52.140715 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:52.142176 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:52.143308 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:52.143905 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:52.144020 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:52.146989 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:52.146993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:52.146993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:52.147006 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:52.149079 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:52.149548 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:52.149552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:52.149553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:52.149654 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:52.149870 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:52.149871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:52.149871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:52.150138 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:52.150285 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:52.150738 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 16:46:52.150867 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":98,"threads_started":1}
I20260811 16:46:52.152307 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:52.159833 32116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:52.153758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37091 (local address 127.27.186.126:34997)
0811 16:46:52.153802 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:52.153804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:52.153935 (+ 131us) server_negotiation.cc:407] Connection header received
0811 16:46:52.154000 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:52.154001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:52.154011 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:52.154066 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:52.154578 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:52.155094 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:52.155832 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:52.156061 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:52.156139 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:52.157299 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:52.157300 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:52.157300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:52.157307 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:52.158645 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:52.159013 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:52.159015 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:52.159015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:52.159076 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:52.159308 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:52.159308 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:52.159309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:52.159419 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:52.159539 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:52.159672 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 16:46:52.159734 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:46:52.161751 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 31961
W20260811 16:46:52.181216 31938 connection.cc:535] client connection to 127.27.186.126:34997 recv error: Network error: failed to read from TLS socket (remote: 127.27.186.126:34997): Connection reset by peer (error 104)
2026-08-11T16:46:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1587 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:52 dist-test-slave-gsp7 krb5kdc[32127](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:52 dist-test-slave-gsp7 krb5kdc[32127](info): set up 2 sockets
Aug 11 16:46:52 dist-test-slave-gsp7 krb5kdc[32127](info): commencing operation
krb5kdc: starting...
W20260811 16:46:53.444144 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:53 dist-test-slave-gsp7 krb5kdc[32127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:53.570643 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35893
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:35893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:53.653590 32155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:53.653790 32155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:53.653813 32155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:53.654978 32155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:53.655023 32155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:53.655037 32155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:53.655050 32155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:53.655107 32155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:53.656553 32155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:35893
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:35893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:53.656821 32155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:53.657061 32155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:53.662256 32165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:53.662262 32163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:53.662289 32162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:53.662438 32155 server_base.cc:1034] running on GCE node
I20260811 16:46:53.662753 32155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:53.663076 32155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:53.664283 32155 hybrid_clock.cc:648] HybridClock initialized: now 1786466813664259 us; error 36 us; skew 500 ppm
Aug 11 16:46:53 dist-test-slave-gsp7 krb5kdc[32127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466813, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:53.667019 32155 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:53.667402 32155 webserver.cc:460] Webserver started at http://127.27.186.126:33163/ using document root <none> and password file <none>
I20260811 16:46:53.667595 32155 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:53.667636 32155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:53.667724 32155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:53.668728 32155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "34da8f0e3228441880b403c82bbd36a9"
format_stamp: "Formatted at 2026-08-11 16:46:53 on dist-test-slave-gsp7"
server_key: "1cb85712b869139f65dfb59c268edf0b"
server_key_iv: "b05298765033085eebfaaaa9ca8cacd7"
server_key_version: "encryptionkey@0"
I20260811 16:46:53.669044 32155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "34da8f0e3228441880b403c82bbd36a9"
format_stamp: "Formatted at 2026-08-11 16:46:53 on dist-test-slave-gsp7"
server_key: "1cb85712b869139f65dfb59c268edf0b"
server_key_iv: "b05298765033085eebfaaaa9ca8cacd7"
server_key_version: "encryptionkey@0"
I20260811 16:46:53.670430 32155 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:46:53.671092 32175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:53.671273 32155 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:53.671366 32155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "34da8f0e3228441880b403c82bbd36a9"
format_stamp: "Formatted at 2026-08-11 16:46:53 on dist-test-slave-gsp7"
server_key: "1cb85712b869139f65dfb59c268edf0b"
server_key_iv: "b05298765033085eebfaaaa9ca8cacd7"
server_key_version: "encryptionkey@0"
I20260811 16:46:53.671430 32155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:53.702772 32155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:53.704675 32155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:53.704798 32155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:53.708771 32155 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:35893
I20260811 16:46:53.708834 32258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:35893 every 8 connection(s)
I20260811 16:46:53.709172 32155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:53.710124 32260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:53.712481 32260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9: Bootstrap starting.
I20260811 16:46:53.713089 32260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:53.713402 32260 log.cc:824] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:53.714159 32260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9: No bootstrap required, opened a new log
I20260811 16:46:53.715777 32260 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34da8f0e3228441880b403c82bbd36a9" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35893 } }
I20260811 16:46:53.715946 32260 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:53.716001 32260 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34da8f0e3228441880b403c82bbd36a9, State: Initialized, Role: FOLLOWER
I20260811 16:46:53.716171 32260 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34da8f0e3228441880b403c82bbd36a9" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35893 } }
I20260811 16:46:53.716275 32260 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:53.716320 32260 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:53.716391 32260 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:53.716571 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 32155
I20260811 16:46:53.716741 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:53.716926 28393 external_mini_cluster.cc:1428] Setting key 36927d38924339b54ff59fb60ca4f521
I20260811 16:46:53.717640 32260 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34da8f0e3228441880b403c82bbd36a9" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35893 } }
I20260811 16:46:53.717779 32260 leader_election.cc:302] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34da8f0e3228441880b403c82bbd36a9; no voters:
I20260811 16:46:53.717985 32260 leader_election.cc:288] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:53.718007 32267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:53.718156 32267 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [term 1 LEADER]: Becoming Leader. State: Replica: 34da8f0e3228441880b403c82bbd36a9, State: Running, Role: LEADER
I20260811 16:46:53.718250 32260 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:53.718308 32267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34da8f0e3228441880b403c82bbd36a9" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35893 } }
I20260811 16:46:53.718696 32267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34da8f0e3228441880b403c82bbd36a9. Latest consensus state: current_term: 1 leader_uuid: "34da8f0e3228441880b403c82bbd36a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34da8f0e3228441880b403c82bbd36a9" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35893 } } }
I20260811 16:46:53.718974 32267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:53.718870 32269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34da8f0e3228441880b403c82bbd36a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34da8f0e3228441880b403c82bbd36a9" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 35893 } } }
I20260811 16:46:53.719172 32269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:53.719611 32277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:53.720187 32277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:53.721899 32277 catalog_manager.cc:1347] Generated new cluster ID: 9d6de25cd6514edbbb9b761945302d7d
I20260811 16:46:53.721963 32277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:53.727270 32266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:53.717497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35173 (local address 127.27.186.126:35893)
0811 16:46:53.717695 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:53.717704 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:53.717739 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:46:53.717880 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:53.717888 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:53.717955 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:53.718364 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:53.718468 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:53.719987 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:53.721129 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:53.721781 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:53.725647 (+ 3866us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:53.726504 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:53.726508 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:53.726508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:53.726744 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:53.726784 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:53.726799 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:53.726880 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:53.727034 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:46:53.727063 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":112,"threads_started":1}
I20260811 16:46:53.728279 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:53.731292 32277 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:53.731935 32277 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:53.734503 32266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:53.729854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48091 (local address 127.27.186.126:35893)
0811 16:46:53.729891 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:53.729892 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:53.730953 (+ 1061us) server_negotiation.cc:407] Connection header received
0811 16:46:53.731038 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:53.731039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:53.731050 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:53.731106 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:53.731261 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:53.731981 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:53.733078 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:53.733390 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:53.733456 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:53.734228 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:53.734229 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:53.734230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:53.734234 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:53.734251 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:53.734256 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:53.734314 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:53.734416 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 16:46:53.734428 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:46:53.739879 32277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34da8f0e3228441880b403c82bbd36a9: Generated new TSK 0
I20260811 16:46:53.740090 32277 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:53.746691 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 32155
W20260811 16:46:53.764070 32123 connection.cc:535] client connection to 127.27.186.126:35893 recv error: Network error: failed to read from TLS socket (remote: 127.27.186.126:35893): Connection reset by peer (error 104)
2026-08-11T16:46:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1582 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:53 dist-test-slave-gsp7 krb5kdc[32299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:53 dist-test-slave-gsp7 krb5kdc[32299](info): set up 2 sockets
Aug 11 16:46:53 dist-test-slave-gsp7 krb5kdc[32299](info): commencing operation
krb5kdc: starting...
W20260811 16:46:55.031490 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:55 dist-test-slave-gsp7 krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:55.160211 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:32797
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:35379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:32797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:55.242467 32323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:55.242718 32323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:55.242758 32323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:55.243932 32323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:55.244002 32323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:55.244027 32323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:55.244047 32323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:55.244076 32323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:55.245599 32323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:35379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:32797
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:32797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:55.245877 32323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:55.246121 32323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:55.251075 32336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:55.251080 32333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:55.251174 32334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:55.251304 32323 server_base.cc:1034] running on GCE node
I20260811 16:46:55.251569 32323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:55.251915 32323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:55.253070 32323 hybrid_clock.cc:648] HybridClock initialized: now 1786466815253044 us; error 38 us; skew 500 ppm
Aug 11 16:46:55 dist-test-slave-gsp7 krb5kdc[32299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466815, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:55.255755 32323 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:55.256259 32323 webserver.cc:460] Webserver started at http://127.27.186.126:46831/ using document root <none> and password file <none>
I20260811 16:46:55.256493 32323 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:55.256541 32323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:55.256716 32323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:55.257920 32323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "16ecf2ccd5f7411c9f534ee7465da06a"
format_stamp: "Formatted at 2026-08-11 16:46:55 on dist-test-slave-gsp7"
server_key: "006a068ea7878b1e1fe4f9bb7c71b038"
server_key_iv: "7ba555feb8921d5da192be1ebff77668"
server_key_version: "encryptionkey@0"
I20260811 16:46:55.258322 32323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "16ecf2ccd5f7411c9f534ee7465da06a"
format_stamp: "Formatted at 2026-08-11 16:46:55 on dist-test-slave-gsp7"
server_key: "006a068ea7878b1e1fe4f9bb7c71b038"
server_key_iv: "7ba555feb8921d5da192be1ebff77668"
server_key_version: "encryptionkey@0"
I20260811 16:46:55.259718 32323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 16:46:55.260474 32347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:55.260675 32323 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:55.260776 32323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "16ecf2ccd5f7411c9f534ee7465da06a"
format_stamp: "Formatted at 2026-08-11 16:46:55 on dist-test-slave-gsp7"
server_key: "006a068ea7878b1e1fe4f9bb7c71b038"
server_key_iv: "7ba555feb8921d5da192be1ebff77668"
server_key_version: "encryptionkey@0"
I20260811 16:46:55.260854 32323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:55.264341 32323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:55.266438 32323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:55.266602 32323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:55.271039 32323 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:32797
I20260811 16:46:55.271122 32430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:32797 every 8 connection(s)
I20260811 16:46:55.271440 32323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:55.272449 32432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:55.274859 32432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a: Bootstrap starting.
I20260811 16:46:55.275310 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 32323
I20260811 16:46:55.275398 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:55.275501 32432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:55.275610 28393 external_mini_cluster.cc:1428] Setting key 2a402ca48dada13435ced391565b9a12
I20260811 16:46:55.275856 32432 log.cc:824] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:55.276657 32432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a: No bootstrap required, opened a new log
I20260811 16:46:55.278298 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:55.276178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51645 (local address 127.27.186.126:32797)
0811 16:46:55.276362 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:55.276373 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:55.276408 (+ 35us) server_negotiation.cc:407] Connection header received
0811 16:46:55.276926 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:55.276934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:55.276960 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:55.277085 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:55.277812 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:55.277815 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:55.277815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:55.277819 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:55.277856 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:55.277866 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:55.277935 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:55.278027 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 16:46:55.278058 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260811 16:46:55.279290 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:55.279273 32432 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16ecf2ccd5f7411c9f534ee7465da06a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32797 } }
I20260811 16:46:55.279448 32432 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:55.279486 32432 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16ecf2ccd5f7411c9f534ee7465da06a, State: Initialized, Role: FOLLOWER
I20260811 16:46:55.279608 32432 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16ecf2ccd5f7411c9f534ee7465da06a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32797 } }
I20260811 16:46:55.279690 32432 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:55.279717 32432 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:55.279770 32432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:55.280498 32432 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16ecf2ccd5f7411c9f534ee7465da06a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32797 } }
I20260811 16:46:55.280638 32432 leader_election.cc:302] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16ecf2ccd5f7411c9f534ee7465da06a; no voters:
I20260811 16:46:55.280807 32432 leader_election.cc:288] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:55.280839 32450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:55.281046 32432 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:55.281050 32450 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [term 1 LEADER]: Becoming Leader. State: Replica: 16ecf2ccd5f7411c9f534ee7465da06a, State: Running, Role: LEADER
I20260811 16:46:55.281268 32450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16ecf2ccd5f7411c9f534ee7465da06a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32797 } }
I20260811 16:46:55.281684 32453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16ecf2ccd5f7411c9f534ee7465da06a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16ecf2ccd5f7411c9f534ee7465da06a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32797 } } }
I20260811 16:46:55.281790 32453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:55.282047 32452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16ecf2ccd5f7411c9f534ee7465da06a. Latest consensus state: current_term: 1 leader_uuid: "16ecf2ccd5f7411c9f534ee7465da06a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16ecf2ccd5f7411c9f534ee7465da06a" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 32797 } } }
I20260811 16:46:55.282171 32452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:55.282044 32461 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:55.282626 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:55.281185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50891 (local address 127.27.186.126:32797)
0811 16:46:55.281227 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:55.281228 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:55.281443 (+ 215us) server_negotiation.cc:407] Connection header received
0811 16:46:55.281558 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:55.281559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:55.281563 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:55.281592 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:55.282369 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:55.282370 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:55.282371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:55.282376 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:55.282392 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:55.282396 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:55.282469 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:55.282551 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 16:46:55.282566 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:46:55.283258 32461 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:55.284849 32461 catalog_manager.cc:1347] Generated new cluster ID: 39239d0e487844af80643b905e20b5cb
I20260811 16:46:55.284909 32461 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:55.304180 32461 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:55.304397 32461 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:55.312978 32461 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16ecf2ccd5f7411c9f534ee7465da06a: Generated new TSK 0
I20260811 16:46:55.313263 32461 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:55.318935 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 32323
2026-08-11T16:46:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:55 dist-test-slave-gsp7 krb5kdc[32481](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:55 dist-test-slave-gsp7 krb5kdc[32481](info): set up 2 sockets
Aug 11 16:46:55 dist-test-slave-gsp7 krb5kdc[32481](info): commencing operation
krb5kdc: starting...
W20260811 16:46:56.606216 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:56 dist-test-slave-gsp7 krb5kdc[32481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:56.732296 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45093
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:38967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:45093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:56.813243 32500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:56.813448 32500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:56.813500 32500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:56.814567 32500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:56.814600 32500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:56.814615 32500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:56.814627 32500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:56.814639 32500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:56.816010 32500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:38967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:45093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:45093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:56.816242 32500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:56.816448 32500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:56.821766 32516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:56.821897 32500 server_base.cc:1034] running on GCE node
W20260811 16:46:56.821781 32513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:56.821781 32519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:56.822225 32500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:56.822574 32500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:56.823745 32500 hybrid_clock.cc:648] HybridClock initialized: now 1786466816823738 us; error 38 us; skew 500 ppm
Aug 11 16:46:56 dist-test-slave-gsp7 krb5kdc[32481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466816, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:56.826279 32500 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:56.826691 32500 webserver.cc:460] Webserver started at http://127.27.186.126:34977/ using document root <none> and password file <none>
I20260811 16:46:56.826913 32500 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:56.826979 32500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:56.827129 32500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:56.828171 32500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "f2e8f880569b44238b4548a43a9f0c3d"
format_stamp: "Formatted at 2026-08-11 16:46:56 on dist-test-slave-gsp7"
server_key: "1eda9685068d713417132151a3b62e63"
server_key_iv: "b45354158af5f2047d8926eeed38f507"
server_key_version: "encryptionkey@0"
I20260811 16:46:56.828533 32500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "f2e8f880569b44238b4548a43a9f0c3d"
format_stamp: "Formatted at 2026-08-11 16:46:56 on dist-test-slave-gsp7"
server_key: "1eda9685068d713417132151a3b62e63"
server_key_iv: "b45354158af5f2047d8926eeed38f507"
server_key_version: "encryptionkey@0"
I20260811 16:46:56.829911 32500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:56.830652 32529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:56.830839 32500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:56.830943 32500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "f2e8f880569b44238b4548a43a9f0c3d"
format_stamp: "Formatted at 2026-08-11 16:46:56 on dist-test-slave-gsp7"
server_key: "1eda9685068d713417132151a3b62e63"
server_key_iv: "b45354158af5f2047d8926eeed38f507"
server_key_version: "encryptionkey@0"
I20260811 16:46:56.831015 32500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:56.842166 32500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:56.843953 32500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:56.844132 32500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:56.848273 32500 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:45093
I20260811 16:46:56.848306 32616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:45093 every 8 connection(s)
I20260811 16:46:56.848651 32500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:56.849552 32617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:56.851812 32617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d: Bootstrap starting.
I20260811 16:46:56.852393 32617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:56.852710 32617 log.cc:824] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:56.853407 32617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d: No bootstrap required, opened a new log
I20260811 16:46:56.855031 32617 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2e8f880569b44238b4548a43a9f0c3d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45093 } }
I20260811 16:46:56.855168 32617 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:56.855191 32617 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2e8f880569b44238b4548a43a9f0c3d, State: Initialized, Role: FOLLOWER
I20260811 16:46:56.855369 32617 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2e8f880569b44238b4548a43a9f0c3d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45093 } }
I20260811 16:46:56.855446 32617 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:56.855494 32617 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:56.855548 32617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:56.856379 32617 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2e8f880569b44238b4548a43a9f0c3d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45093 } }
I20260811 16:46:56.856503 32617 leader_election.cc:302] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2e8f880569b44238b4548a43a9f0c3d; no voters:
I20260811 16:46:56.856688 32617 leader_election.cc:288] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:56.856724 32621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:56.856894 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 32500
I20260811 16:46:56.856984 32621 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [term 1 LEADER]: Becoming Leader. State: Replica: f2e8f880569b44238b4548a43a9f0c3d, State: Running, Role: LEADER
I20260811 16:46:56.857012 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:56.857002 32617 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:56.857082 32621 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2e8f880569b44238b4548a43a9f0c3d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45093 } }
I20260811 16:46:56.857192 28393 external_mini_cluster.cc:1428] Setting key 34f0bcaf2ca75b1e3d390b7b899c0449
I20260811 16:46:56.857461 32622 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2e8f880569b44238b4548a43a9f0c3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2e8f880569b44238b4548a43a9f0c3d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45093 } } }
I20260811 16:46:56.857595 32622 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:56.857462 32623 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2e8f880569b44238b4548a43a9f0c3d. Latest consensus state: current_term: 1 leader_uuid: "f2e8f880569b44238b4548a43a9f0c3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2e8f880569b44238b4548a43a9f0c3d" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 45093 } } }
I20260811 16:46:56.857752 32623 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d [sys.catalog]: This master's current role is: LEADER
W20260811 16:46:56.859242 32654 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:46:56.859306 32654 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:46:56.859354 32629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:56.859521 32629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:56.861187 32629 catalog_manager.cc:1347] Generated new cluster ID: 3aebfb022a5748569172b3d7154f932c
I20260811 16:46:56.861253 32629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 16:46:56 dist-test-slave-gsp7 krb5kdc[32481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:46:56.866976 32629 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:56.867980 32629 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:56.869853 32631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:56.857667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57857 (local address 127.27.186.126:45093)
0811 16:46:56.858335 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:56.858345 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:56.858384 (+ 39us) server_negotiation.cc:407] Connection header received
0811 16:46:56.858505 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:56.858513 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:56.858605 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:56.858761 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:56.859714 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:56.860927 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:56.862106 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:56.862759 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:56.862882 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:56.865949 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:56.865954 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:56.865954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:56.865967 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:56.868010 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:56.868492 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:56.868496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:56.868496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:56.868601 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:56.868841 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:56.868842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:56.868843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:56.869082 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:56.869273 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:56.869417 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 16:46:56.869612 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":84,"threads_started":1}
I20260811 16:46:56.870878 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:56.879033 32631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:56.872480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45393 (local address 127.27.186.126:45093)
0811 16:46:56.872526 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:56.872528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:56.872680 (+ 152us) server_negotiation.cc:407] Connection header received
0811 16:46:56.872753 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:56.872754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:56.872764 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:56.872820 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:56.873365 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:56.873962 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:56.874730 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:56.874956 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:56.875051 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:56.876316 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:56.876317 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:56.876317 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:46:56.876325 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:56.877839 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:56.878215 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:56.878216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:56.878216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:56.878278 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:46:56.878485 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:46:56.878486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:46:56.878487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:46:56.878603 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:56.878705 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:56.878827 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 16:46:56.878913 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 16:46:56.884408 32629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2e8f880569b44238b4548a43a9f0c3d: Generated new TSK 0
I20260811 16:46:56.884611 32629 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:56.887133 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 32500
2026-08-11T16:46:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1557 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:56 dist-test-slave-gsp7 krb5kdc[32675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:56 dist-test-slave-gsp7 krb5kdc[32675](info): set up 2 sockets
Aug 11 16:46:56 dist-test-slave-gsp7 krb5kdc[32675](info): commencing operation
krb5kdc: starting...
W20260811 16:46:58.159881 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:58 dist-test-slave-gsp7 krb5kdc[32675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:58.286406 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:37329
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:44483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:37329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:58.368849 32693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:58.369062 32693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:58.369086 32693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:58.370334 32693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:58.370379 32693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:58.370394 32693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:58.370407 32693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:58.370460 32693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:58.371902 32693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:44483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:37329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:37329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:58.372166 32693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:58.372397 32693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:58.377548 32702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:58.377573 32706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:58.377534 32693 server_base.cc:1034] running on GCE node
W20260811 16:46:58.377535 32701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:58.377991 32693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:58.378319 32693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:58.379490 32693 hybrid_clock.cc:648] HybridClock initialized: now 1786466818379475 us; error 49 us; skew 500 ppm
Aug 11 16:46:58 dist-test-slave-gsp7 krb5kdc[32675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466818, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:58.382022 32693 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:58.382506 32693 webserver.cc:460] Webserver started at http://127.27.186.126:43959/ using document root <none> and password file <none>
I20260811 16:46:58.382735 32693 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:58.382802 32693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:58.382961 32693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:58.384029 32693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "3cea349c1c884adabb4bd0af30396198"
format_stamp: "Formatted at 2026-08-11 16:46:58 on dist-test-slave-gsp7"
server_key: "8f35a5af6faee33337b338753b47bb5f"
server_key_iv: "561535204f837df3e330105dcd550cb4"
server_key_version: "encryptionkey@0"
I20260811 16:46:58.384404 32693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "3cea349c1c884adabb4bd0af30396198"
format_stamp: "Formatted at 2026-08-11 16:46:58 on dist-test-slave-gsp7"
server_key: "8f35a5af6faee33337b338753b47bb5f"
server_key_iv: "561535204f837df3e330105dcd550cb4"
server_key_version: "encryptionkey@0"
I20260811 16:46:58.385811 32693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 16:46:58.386580 32720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:58.386780 32693 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:46:58.386888 32693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "3cea349c1c884adabb4bd0af30396198"
format_stamp: "Formatted at 2026-08-11 16:46:58 on dist-test-slave-gsp7"
server_key: "8f35a5af6faee33337b338753b47bb5f"
server_key_iv: "561535204f837df3e330105dcd550cb4"
server_key_version: "encryptionkey@0"
I20260811 16:46:58.386978 32693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:58.401983 32693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:58.403815 32693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:58.403985 32693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:58.408326 32693 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:37329
I20260811 16:46:58.408365 336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:37329 every 8 connection(s)
I20260811 16:46:58.408732 32693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:58.409653 337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:58.412040 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 32693
I20260811 16:46:58.412034 337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198: Bootstrap starting.
I20260811 16:46:58.412163 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:58.412354 28393 external_mini_cluster.cc:1428] Setting key a51f8f854584c9191d99125f116d9175
I20260811 16:46:58.412796 337 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:58.413198 337 log.cc:824] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:58.414032 337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198: No bootstrap required, opened a new log
I20260811 16:46:58.416230 337 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cea349c1c884adabb4bd0af30396198" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37329 } }
I20260811 16:46:58.416409 337 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:58.416438 337 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cea349c1c884adabb4bd0af30396198, State: Initialized, Role: FOLLOWER
I20260811 16:46:58.416599 337 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cea349c1c884adabb4bd0af30396198" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37329 } }
I20260811 16:46:58.416659 337 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:58.416715 337 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:58.416764 337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:58.417532 337 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cea349c1c884adabb4bd0af30396198" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37329 } }
I20260811 16:46:58.417655 337 leader_election.cc:302] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cea349c1c884adabb4bd0af30396198; no voters:
I20260811 16:46:58.417832 337 leader_election.cc:288] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:58.417881 345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:58.418094 345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [term 1 LEADER]: Becoming Leader. State: Replica: 3cea349c1c884adabb4bd0af30396198, State: Running, Role: LEADER
I20260811 16:46:58.418119 337 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:58.418238 345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cea349c1c884adabb4bd0af30396198" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37329 } }
I20260811 16:46:58.418617 345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cea349c1c884adabb4bd0af30396198. Latest consensus state: current_term: 1 leader_uuid: "3cea349c1c884adabb4bd0af30396198" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cea349c1c884adabb4bd0af30396198" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37329 } } }
I20260811 16:46:58.418690 343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:58.412880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36305 (local address 127.27.186.126:37329)
0811 16:46:58.413042 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:58.413050 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:58.413076 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:46:58.413683 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:58.413693 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:58.413768 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:58.413882 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:58.414166 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:58.415085 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:58.416320 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:58.416919 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:58.417003 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:58.417751 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:58.417756 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:58.417756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:58.417989 (+ 233us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:58.418032 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:58.418048 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:58.418379 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:58.418411 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 16:46:58.418490 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260811 16:46:58.418630 346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cea349c1c884adabb4bd0af30396198" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cea349c1c884adabb4bd0af30396198" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 37329 } } }
I20260811 16:46:58.418709 345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:58.418735 346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:58.419137 353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:58.419899 353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:58.420049 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:58.421972 353 catalog_manager.cc:1347] Generated new cluster ID: 38d0512bc9eb4a39969d83e4d2236363
I20260811 16:46:58.422026 353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:58.429101 343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:58.421649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41237 (local address 127.27.186.126:37329)
0811 16:46:58.421685 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:58.421687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:58.425720 (+ 4033us) server_negotiation.cc:407] Connection header received
0811 16:46:58.425789 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:58.425790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:58.425800 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:58.425857 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:58.425989 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:58.426698 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:58.427729 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:46:58.428013 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:46:58.428072 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:46:58.428848 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:58.428849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:58.428850 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:58.428854 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:58.428867 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:58.428871 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:58.428923 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:58.429007 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 16:46:58.429027 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 16:46:58.436285 353 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:58.436784 353 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:58.439788 353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cea349c1c884adabb4bd0af30396198: Generated new TSK 0
I20260811 16:46:58.439976 353 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:46:58.449625 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 32693
2026-08-11T16:46:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1564 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:46:58 dist-test-slave-gsp7 krb5kdc[380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:46:58 dist-test-slave-gsp7 krb5kdc[380](info): set up 2 sockets
Aug 11 16:46:58 dist-test-slave-gsp7 krb5kdc[380](info): commencing operation
krb5kdc: starting...
W20260811 16:46:59.729245 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:46:59 dist-test-slave-gsp7 krb5kdc[380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:46:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:46:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:46:59.854362 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:36775
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:37721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:36775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:46:59.937417 399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:46:59.937630 399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:46:59.937652 399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:46:59.938787 399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:46:59.938832 399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:46:59.938850 399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:46:59.938903 399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:46:59.938925 399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:46:59.940466 399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:37721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:36775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:36775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:46:59.940727 399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:46:59.940972 399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:46:59.945999 417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:46:59.945991 414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:59.946175 399 server_base.cc:1034] running on GCE node
W20260811 16:46:59.946061 415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:46:59.946486 399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:46:59.946800 399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:46:59.947952 399 hybrid_clock.cc:648] HybridClock initialized: now 1786466819947926 us; error 45 us; skew 500 ppm
Aug 11 16:46:59 dist-test-slave-gsp7 krb5kdc[380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466819, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:46:59.950469 399 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:46:59.950901 399 webserver.cc:460] Webserver started at http://127.27.186.126:39053/ using document root <none> and password file <none>
I20260811 16:46:59.951149 399 fs_manager.cc:359] Metadata directory not provided
I20260811 16:46:59.951218 399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:46:59.951368 399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:46:59.952483 399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "9504d7b4466943728ebeb1201d720af2"
format_stamp: "Formatted at 2026-08-11 16:46:59 on dist-test-slave-gsp7"
server_key: "9e37f8437bef3d343a7c3eae45960acf"
server_key_iv: "f93ed250a2300cf2d315047cb0f9592f"
server_key_version: "encryptionkey@0"
I20260811 16:46:59.952901 399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "9504d7b4466943728ebeb1201d720af2"
format_stamp: "Formatted at 2026-08-11 16:46:59 on dist-test-slave-gsp7"
server_key: "9e37f8437bef3d343a7c3eae45960acf"
server_key_iv: "f93ed250a2300cf2d315047cb0f9592f"
server_key_version: "encryptionkey@0"
I20260811 16:46:59.954386 399 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 16:46:59.955137 426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:46:59.955308 399 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:46:59.955422 399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "9504d7b4466943728ebeb1201d720af2"
format_stamp: "Formatted at 2026-08-11 16:46:59 on dist-test-slave-gsp7"
server_key: "9e37f8437bef3d343a7c3eae45960acf"
server_key_iv: "f93ed250a2300cf2d315047cb0f9592f"
server_key_version: "encryptionkey@0"
I20260811 16:46:59.955500 399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:46:59.958864 399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:46:59.960748 399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:46:59.960906 399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:46:59.964879 399 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:36775
I20260811 16:46:59.964910 510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:36775 every 8 connection(s)
I20260811 16:46:59.965233 399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:46:59.966264 512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:46:59.968546 512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2: Bootstrap starting.
I20260811 16:46:59.969146 512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2: Neither blocks nor log segments found. Creating new log.
I20260811 16:46:59.969525 512 log.cc:824] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2: Log is configured to *not* fsync() on all Append() calls
I20260811 16:46:59.969738 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 399
I20260811 16:46:59.969866 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:46:59.970059 28393 external_mini_cluster.cc:1428] Setting key b41dd26951c5171e105614846fbc20e5
I20260811 16:46:59.970445 512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2: No bootstrap required, opened a new log
I20260811 16:46:59.972797 512 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9504d7b4466943728ebeb1201d720af2" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36775 } }
I20260811 16:46:59.973043 512 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 16:46:59.973119 512 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9504d7b4466943728ebeb1201d720af2, State: Initialized, Role: FOLLOWER
I20260811 16:46:59.973249 512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9504d7b4466943728ebeb1201d720af2" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36775 } }
I20260811 16:46:59.973362 512 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 16:46:59.973390 520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:59.970588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44699 (local address 127.27.186.126:36775)
0811 16:46:59.970783 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:59.970793 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:59.970830 (+ 37us) server_negotiation.cc:407] Connection header received
0811 16:46:59.971854 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:59.971864 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:59.971901 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:59.972065 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:59.972720 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:59.972724 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:59.972724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:59.972729 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:59.972774 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:59.972790 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:59.972870 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:59.972923 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 16:46:59.972971 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260811 16:46:59.973402 512 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 16:46:59.973507 512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:46:59.974128 512 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9504d7b4466943728ebeb1201d720af2" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36775 } }
I20260811 16:46:59.974247 512 leader_election.cc:302] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9504d7b4466943728ebeb1201d720af2; no voters:
I20260811 16:46:59.974427 512 leader_election.cc:288] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 16:46:59.974428 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:46:59.974485 521 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:46:59.974614 521 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [term 1 LEADER]: Becoming Leader. State: Replica: 9504d7b4466943728ebeb1201d720af2, State: Running, Role: LEADER
I20260811 16:46:59.974684 512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:46:59.974751 521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9504d7b4466943728ebeb1201d720af2" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36775 } }
I20260811 16:46:59.975204 522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9504d7b4466943728ebeb1201d720af2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9504d7b4466943728ebeb1201d720af2" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36775 } } }
I20260811 16:46:59.975308 522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [sys.catalog]: This master's current role is: LEADER
I20260811 16:46:59.975509 523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9504d7b4466943728ebeb1201d720af2. Latest consensus state: current_term: 1 leader_uuid: "9504d7b4466943728ebeb1201d720af2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9504d7b4466943728ebeb1201d720af2" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 36775 } } }
I20260811 16:46:59.975894 523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2 [sys.catalog]: This master's current role is: LEADER
W20260811 16:46:59.976590 553 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:46:59.976684 553 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:46:59.976755 536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:46:59.976963 536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:46:59.978762 520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:46:59.976582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48881 (local address 127.27.186.126:36775)
0811 16:46:59.976644 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 16:46:59.976646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:46:59.977645 (+ 999us) server_negotiation.cc:407] Connection header received
0811 16:46:59.977751 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:46:59.977752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:46:59.977757 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:46:59.977825 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:46:59.978513 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:46:59.978514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:46:59.978515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 16:46:59.978518 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:46:59.978531 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 16:46:59.978535 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:46:59.978613 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:46:59.978680 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 16:46:59.978693 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:46:59.978789 536 catalog_manager.cc:1347] Generated new cluster ID: 1221ffff112b4e0aa2493ab78f30481a
I20260811 16:46:59.978823 536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:46:59.994753 536 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:46:59.994966 536 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:46:59.998703 536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9504d7b4466943728ebeb1201d720af2: Generated new TSK 0
I20260811 16:46:59.998919 536 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:47:00.001257 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 399
2026-08-11T16:47:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1548 ms)
[----------] 18 tests from AuthTokenIssuingTest (28448 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:00 dist-test-slave-gsp7 krb5kdc[564](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:00 dist-test-slave-gsp7 krb5kdc[564](info): set up 2 sockets
Aug 11 16:47:00 dist-test-slave-gsp7 krb5kdc[564](info): commencing operation
krb5kdc: starting...
W20260811 16:47:01.287185 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:47:01.415799 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41807
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:41807,127.27.186.125:33763,127.27.186.124:41643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:01.499370 587 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:47:01.499655 587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:01.499689 587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:01.499748 587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:01.500957 587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:01.501029 587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:01.501055 587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:01.501084 587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:01.501113 587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:01.502621 587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:41807,127.27.186.125:33763,127.27.186.124:41643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:41807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:01.502905 587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:01.503151 587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:01.508342 596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:01.508361 599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:01.508375 597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:01.508625 587 server_base.cc:1034] running on GCE node
I20260811 16:47:01.508860 587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:01.509157 587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:01.510304 587 hybrid_clock.cc:648] HybridClock initialized: now 1786466821510295 us; error 36 us; skew 500 ppm
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:01.512970 587 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:47:01.513557 587 webserver.cc:460] Webserver started at http://127.27.186.126:46165/ using document root <none> and password file <none>
I20260811 16:47:01.513795 587 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:01.513842 587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:01.513972 587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:01.515111 587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "507ca76794974affaa0900c0d8793260"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "66053a1dcd9b70f72104047b6dba74fc"
server_key_iv: "ebb717650454926364588cba496a5e91"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.515519 587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "507ca76794974affaa0900c0d8793260"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "66053a1dcd9b70f72104047b6dba74fc"
server_key_iv: "ebb717650454926364588cba496a5e91"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.516952 587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:01.517789 614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:01.517964 587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:01.518079 587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "507ca76794974affaa0900c0d8793260"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "66053a1dcd9b70f72104047b6dba74fc"
server_key_iv: "ebb717650454926364588cba496a5e91"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.518157 587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:01.536517 587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:01.539075 587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:01.539254 587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:01.543661 587 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:41807
I20260811 16:47:01.543699 697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:41807 every 8 connection(s)
I20260811 16:47:01.544094 587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:01.544974 699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:01.547151 699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:01.551180 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 587
I20260811 16:47:01.551277 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:47:01.551489 28393 external_mini_cluster.cc:1428] Setting key 4c2f1037e7b15add0b2e2e5147905ed6
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:47:01.557551 703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.548116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37128 (local address 127.27.186.126:41807)
0811 16:47:01.548285 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.548295 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.548409 (+ 114us) server_negotiation.cc:407] Connection header received
0811 16:47:01.548930 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.548931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.548949 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.549048 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.549653 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.550497 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.551387 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.551781 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.551914 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.554258 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.554266 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.554266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.554274 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.555909 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.556313 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.556315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.556315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.556380 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.556657 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.556657 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.556658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.556863 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.556939 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.557219 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.557324 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":101,"threads_started":1}
I20260811 16:47:01.557695 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.548093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41807 (local address 127.0.0.1:37128)
0811 16:47:01.548276 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.548316 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.548801 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.549074 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.549076 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.549321 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.549560 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.549565 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.550587 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.550588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.551305 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.551307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.551886 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.551887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.551955 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.552598 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.552608 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.554168 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.556028 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.556032 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.556034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.556249 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.556436 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.556437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.556438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.556579 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.556942 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.556951 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.557058 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.557173 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.557450 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":83,"thread_start_us":96,"threads_started":1}
I20260811 16:47:01.558530 699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:01.558954 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.558809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55292)
0811 16:47:01.558868 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.558926 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 16:47:01.559122 616 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
I20260811 16:47:01.559644 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.559526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55300)
0811 16:47:01.559579 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.559614 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:47:01.559800 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:33763: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.27.186.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab.
Entry for principal kudu/127.27.186.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab.
I20260811 16:47:01.580866 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.125:33763
--webserver_interface=127.27.186.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab
--principal=kudu/127.27.186.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:41807,127.27.186.125:33763,127.27.186.124:41643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:47:01.609054 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } attempt: 1
I20260811 16:47:01.609651 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.609454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55302)
0811 16:47:01.609563 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.609613 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 16:47:01.610052 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.609933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55316)
0811 16:47:01.609986 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.610016 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 16:47:01.610188 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:33763: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
W20260811 16:47:01.666334 710 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:47:01.666567 710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:01.666585 710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:01.666607 710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:01.667816 710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:01.667860 710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:01.667874 710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:01.667929 710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:01.667956 710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:01.669525 710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:41807,127.27.186.125:33763,127.27.186.124:41643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab
--principal=kudu/127.27.186.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.125:33763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.186.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:01.669792 710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:01.670068 710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:01.675103 718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:01.675097 719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:01.675105 723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:01.675393 710 server_base.cc:1034] running on GCE node
I20260811 16:47:01.675635 710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:01.675936 710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:01.677093 710 hybrid_clock.cc:648] HybridClock initialized: now 1786466821677067 us; error 41 us; skew 500 ppm
I20260811 16:47:01.678356 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } attempt: 2
I20260811 16:47:01.678761 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.678630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55318)
0811 16:47:01.678692 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.678722 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 16:47:01.679101 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.678998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55328)
0811 16:47:01.679052 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.679076 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 16:47:01.679219 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:33763: Network error: Client connection negotiation failed: client connection to 127.27.186.125:33763: connect: Connection refused (error 111)
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:01.680043 710 init.cc:377] Logged in from keytab as kudu/127.27.186.125@KRBTEST.COM (short username kudu)
I20260811 16:47:01.680531 710 webserver.cc:460] Webserver started at http://127.27.186.125:38359/ using document root <none> and password file <none>
I20260811 16:47:01.680789 710 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:01.680859 710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:01.681025 710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:01.682179 710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/data/instance:
uuid: "3ecbdfac0859416c9c70eb274297ab57"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "60d2dd1836a4bc65f1e5cd507d26d171"
server_key_iv: "b7a075e98213d639858bef907bb0e2b4"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.682570 710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/wal/instance:
uuid: "3ecbdfac0859416c9c70eb274297ab57"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "60d2dd1836a4bc65f1e5cd507d26d171"
server_key_iv: "b7a075e98213d639858bef907bb0e2b4"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.683938 710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:01.684743 733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:01.684917 710 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:01.685038 710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/wal
uuid: "3ecbdfac0859416c9c70eb274297ab57"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "60d2dd1836a4bc65f1e5cd507d26d171"
server_key_iv: "b7a075e98213d639858bef907bb0e2b4"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.685117 710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:01.699632 710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:01.702137 710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:01.702313 710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:01.706697 710 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.125:33763
I20260811 16:47:01.706727 820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.125:33763 every 8 connection(s)
I20260811 16:47:01.707101 710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
I20260811 16:47:01.707974 825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:01.709470 825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:47:01.716948 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 710
I20260811 16:47:01.717075 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-1/wal/instance
I20260811 16:47:01.717298 28393 external_mini_cluster.cc:1428] Setting key 4af8f7321c8e964fdbcfe77a570cfb5b
I20260811 16:47:01.718724 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.710258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41807 (local address 127.0.0.1:37136)
0811 16:47:01.710437 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.710485 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.710963 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.711230 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.711233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.711469 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.711671 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.711675 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.712345 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.712346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.713122 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.713124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.713578 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.713579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.713684 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.714247 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.714256 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.715651 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.717285 (+ 1634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.717292 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.717293 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.717631 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.717845 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.717845 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.717846 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.717956 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.718239 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.718244 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.718357 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.718441 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.718563 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260811 16:47:01.718724 703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.710296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37136 (local address 127.27.186.126:41807)
0811 16:47:01.710372 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.710374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.710591 (+ 217us) server_negotiation.cc:407] Connection header received
0811 16:47:01.711078 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.711079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.711094 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.711151 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.711746 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.712256 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.713221 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.713432 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.713553 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.715741 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.715742 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.715743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.715750 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.717207 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.717708 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.717710 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.717710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.717775 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.718020 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.718021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.718021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.718173 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.718245 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.718486 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.718580 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 16:47:01.719324 825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
WARNING: no policy specified for kudu/127.27.186.124@KRBTEST.COM; defaulting to no policy
I20260811 16:47:01.727739 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.719628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55332)
0811 16:47:01.719694 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.719708 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.719759 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.719994 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.719995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.720162 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.720227 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.720228 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.721665 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.721666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.722227 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.722229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.722943 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.722944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.723003 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.723472 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.723477 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.724850 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.726696 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.726697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.726698 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.726871 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.727157 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.727158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.727159 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.727219 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.727499 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.727500 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.727536 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.727589 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.727671 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 16:47:01.727820 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.719683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55332 (local address 127.27.186.125:33763)
0811 16:47:01.719839 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.719843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.719863 (+ 20us) server_negotiation.cc:407] Connection header received
0811 16:47:01.719893 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.719895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.719906 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.719970 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.720427 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.721567 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.722312 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.722856 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.722940 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.724938 (+ 1998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.724947 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.724947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.724954 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.726588 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.726991 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.726995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.726995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.727060 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.727290 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.727291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.727291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.727433 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.727506 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.727635 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.727723 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260811 16:47:01.728618 825 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:01.728994 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.728884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52078)
0811 16:47:01.728929 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.728975 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 16:47:01.729180 735 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
I20260811 16:47:01.729729 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.729621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52082)
0811 16:47:01.729652 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.729698 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.124@KRBTEST.COM" created.
W20260811 16:47:01.729856 825 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:41643: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab.
Entry for principal kudu/127.27.186.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab.
I20260811 16:47:01.746603 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.124:41643
--webserver_interface=127.27.186.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab
--principal=kudu/127.27.186.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:41859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:41807,127.27.186.125:33763,127.27.186.124:41643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:47:01.770377 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } attempt: 3
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:47:01.778072 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.770816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55346)
0811 16:47:01.770884 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.770897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.770956 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.771111 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.771113 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.771286 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.771354 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.771356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.772062 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.772064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.772609 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.772612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.773020 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.773021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.773107 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.773656 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.773661 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.775097 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.777006 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.777007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.777008 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.777177 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.777395 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.777395 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.777396 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.777449 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.777795 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.777796 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.777846 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.777908 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.777996 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 16:47:01.778136 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.770891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55346 (local address 127.27.186.125:33763)
0811 16:47:01.770973 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.770975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.770986 (+ 11us) server_negotiation.cc:407] Connection header received
0811 16:47:01.771020 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.771021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.771031 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.771105 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.771447 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.771969 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.772704 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.772935 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.773022 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.775196 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.775197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.775197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.775207 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.776901 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.777257 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.777258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.777259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.777324 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.777578 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.777579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.777580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.777725 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.777799 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.777958 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.778044 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:47:01.778584 699 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:01.778991 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.778881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52090)
0811 16:47:01.778932 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.778970 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:47:01.779093 825 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } attempt: 1
I20260811 16:47:01.779436 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.779345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52106)
0811 16:47:01.779382 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.779409 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260811 16:47:01.779560 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.779426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52114)
0811 16:47:01.779459 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.779485 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260811 16:47:01.779656 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:41643: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
I20260811 16:47:01.779734 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.779660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52130)
0811 16:47:01.779693 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.779714 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260811 16:47:01.779837 825 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:41643: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
I20260811 16:47:01.810853 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } attempt: 1
I20260811 16:47:01.811515 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.811336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52146)
0811 16:47:01.811429 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.811479 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 16:47:01.811960 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.811831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52154)
0811 16:47:01.811904 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.811936 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 16:47:01.812114 699 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:41643: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
W20260811 16:47:01.834118 836 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:47:01.834331 836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:01.834349 836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:01.834370 836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:01.835554 836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:01.835595 836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:01.835609 836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:01.835623 836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:01.835659 836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:01.837149 836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:41859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:41807,127.27.186.125:33763,127.27.186.124:41643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab
--principal=kudu/127.27.186.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.124:41643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.186.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:01.837411 836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:01.837671 836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:01.842599 842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:01.842710 844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:01.842600 847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:01.842839 836 server_base.cc:1034] running on GCE node
I20260811 16:47:01.843456 836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:01.843757 836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:01.844923 836 hybrid_clock.cc:648] HybridClock initialized: now 1786466821844910 us; error 35 us; skew 500 ppm
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:01.847678 836 init.cc:377] Logged in from keytab as kudu/127.27.186.124@KRBTEST.COM (short username kudu)
I20260811 16:47:01.848023 825 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } attempt: 2
I20260811 16:47:01.848345 836 webserver.cc:460] Webserver started at http://127.27.186.124:46477/ using document root <none> and password file <none>
I20260811 16:47:01.848510 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.848318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52168)
0811 16:47:01.848390 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.848437 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 16:47:01.848691 836 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:01.848779 836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:01.848865 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.848761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52184)
0811 16:47:01.848810 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.848835 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 16:47:01.848929 836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
W20260811 16:47:01.848944 825 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:41643: Network error: Client connection negotiation failed: client connection to 127.27.186.124:41643: connect: Connection refused (error 111)
I20260811 16:47:01.850194 836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/data/instance:
uuid: "3ca0881324f949b1940a2ac0ff128af9"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "14c4f18a5af14c72f9a4212539222447"
server_key_iv: "4a53120242efbfe43a9304f6029db25c"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.850586 836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/wal/instance:
uuid: "3ca0881324f949b1940a2ac0ff128af9"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "14c4f18a5af14c72f9a4212539222447"
server_key_iv: "4a53120242efbfe43a9304f6029db25c"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.852026 836 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 16:47:01.852802 855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:01.853037 836 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:01.853137 836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/wal
uuid: "3ca0881324f949b1940a2ac0ff128af9"
format_stamp: "Formatted at 2026-08-11 16:47:01 on dist-test-slave-gsp7"
server_key: "14c4f18a5af14c72f9a4212539222447"
server_key_iv: "4a53120242efbfe43a9304f6029db25c"
server_key_version: "encryptionkey@0"
I20260811 16:47:01.853200 836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:01.870710 836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:01.872869 836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:01.872998 836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:01.877518 836 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.124:41643
I20260811 16:47:01.877615 931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.124:41643 every 8 connection(s)
I20260811 16:47:01.878013 836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
I20260811 16:47:01.878984 932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:01.880628 932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:01.882296 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 836
I20260811 16:47:01.882427 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786466533930122-28393-0/minicluster-data/master-2/wal/instance
I20260811 16:47:01.882632 28393 external_mini_cluster.cc:1428] Setting key 3eeedba070db6658d38e0b0f13080e6d
I20260811 16:47:01.887293 699 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } attempt: 2
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
I20260811 16:47:01.892247 703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.881447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37140 (local address 127.27.186.126:41807)
0811 16:47:01.881554 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.881557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.881750 (+ 193us) server_negotiation.cc:407] Connection header received
0811 16:47:01.882432 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.882434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.882446 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.882547 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.883514 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.884296 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.885726 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.886017 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.886092 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.888723 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.888725 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.888725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.888735 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.890507 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.891009 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.891011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.891011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.891090 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.891387 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.891389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.891389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.891560 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.891629 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.892005 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.892100 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 16:47:01.892432 935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.881404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:41807 (local address 127.0.0.1:37140)
0811 16:47:01.881626 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.881663 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.882275 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.882643 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.882646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.883085 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.883408 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.883416 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.884370 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.884371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.885605 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.885609 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.886105 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.886106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.886216 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.886768 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.886778 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.888613 (+ 1835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.890606 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.890613 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.890615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.890897 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.891167 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.891167 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.891168 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.891317 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.891662 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.891670 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.891837 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.891954 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.892171 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":128,"threads_started":1}
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
I20260811 16:47:01.893144 932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:01.894204 937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.883094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52186 (local address 127.27.186.124:41643)
0811 16:47:01.883276 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.883282 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.883305 (+ 23us) server_negotiation.cc:407] Connection header received
0811 16:47:01.883369 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.883372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.883394 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.883476 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.884227 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.885638 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.886556 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.887065 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.887147 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.890396 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.890405 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.890405 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.890414 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.892386 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.892830 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.892832 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.892833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.892896 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.893321 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.893322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.893322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.893537 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.893679 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.893955 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.894050 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":107,"threads_started":1}
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:47:01.897840 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.887878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52196)
0811 16:47:01.887941 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.887954 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.888029 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.888278 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.888279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.888454 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.888500 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.888502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.889542 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.889543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.890465 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.890468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.891176 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.891176 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.891222 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.891752 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.891756 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.893327 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.896652 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.896653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.896654 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.896851 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.897092 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.897093 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.897094 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.897167 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.897513 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.897514 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.897567 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.897651 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.897740 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 16:47:01.897907 938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.887959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52196 (local address 127.27.186.124:41643)
0811 16:47:01.888118 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.888120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.888129 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:01.888151 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.888151 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.888161 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.888582 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.888632 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.889408 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.890583 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.890950 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.891035 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.893419 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.893420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.893420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.893428 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.896562 (+ 3134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.896949 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.896950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.896950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.897026 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.897244 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.897245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.897245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.897389 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.897465 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.897694 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.897778 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":113,"threads_started":1}
I20260811 16:47:01.900374 699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260: Bootstrap starting.
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:47:01.901212 699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:01.901540 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.893580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55362 (local address 127.27.186.125:33763)
0811 16:47:01.893635 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.893637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.893646 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:01.893676 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.893677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.893692 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.893747 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.894127 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.894783 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.895820 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.896192 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.896287 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.898464 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.898465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.898466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.898474 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.900176 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.900596 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.900597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.900598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.900668 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.900903 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.900904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.900904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.901035 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.901113 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.901289 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.901382 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:47:01.901615 699 log.cc:824] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:01.901775 935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.893413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:33763 (local address 127.0.0.1:55362)
0811 16:47:01.893525 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.893536 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.893574 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.893770 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.893771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.893946 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.894016 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.894018 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.894899 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.894900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.895694 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.895697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.896284 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.896285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.896358 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.896745 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.896749 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.898345 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.900295 (+ 1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.900296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.900296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.900526 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.900744 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.900745 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.900746 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.900810 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.901120 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.901121 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.901166 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.901260 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.901692 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 16:47:01.902411 932 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:01.902577 699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260: No bootstrap required, opened a new log
I20260811 16:47:01.904233 703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.895265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37148 (local address 127.27.186.126:41807)
0811 16:47:01.895313 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.895315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.895324 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:01.895345 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.895346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.895355 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.895417 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.896221 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.896935 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.898035 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.898319 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.898389 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.901082 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.901083 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.901083 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.901091 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.902952 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.903353 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.903354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.903355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.903422 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.903655 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.903656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.903656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.903795 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.903963 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.904052 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.904140 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:47:01.904944 699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } }
I20260811 16:47:01.905107 699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 507ca76794974affaa0900c0d8793260, State: Initialized, Role: FOLLOWER
I20260811 16:47:01.905260 699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } }
I20260811 16:47:01.905879 699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:01.905804 940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.906575 940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: This master's current role is: FOLLOWER
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
W20260811 16:47:01.908641 955 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:01.908701 955 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:47:01.910845 935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.902669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52212)
0811 16:47:01.902712 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.902726 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.902776 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.902901 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.902902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.903072 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.903116 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.903118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.904067 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.904068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.904926 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.904929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.905435 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.905436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.905519 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.905960 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.905966 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.907383 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.909660 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.909661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.909662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.909888 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.910107 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.910108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.910108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.910164 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.910533 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.910534 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.910576 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.910628 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.910733 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 16:47:01.908963 587 master_runner.cc:186] Error getting master registration for 127.27.186.125:33763: OK, instance_id { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" instance_seqno: 1786466821705365 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:47:01.912158 938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.902764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52212 (local address 127.27.186.124:41643)
0811 16:47:01.902795 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.902797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.902804 (+ 7us) server_negotiation.cc:407] Connection header received
0811 16:47:01.902828 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.902829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.902839 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.902894 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.903198 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.903977 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.905023 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.905348 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.905438 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.907500 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.907501 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.907501 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.907518 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.909558 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.909971 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.909971 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.909972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.910034 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.910235 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.910235 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.910236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.910424 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.911568 (+ 1144us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.911623 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.912030 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 16:47:01.912201 587 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:47:01.913954 932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9: Bootstrap starting.
I20260811 16:47:01.914099 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.904992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55374 (local address 127.27.186.125:33763)
0811 16:47:01.905032 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.905033 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.905042 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:01.905066 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.905066 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.905076 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.905135 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.905804 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.906481 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.907475 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.907701 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.907750 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.910802 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.910803 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.910803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.910811 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.912816 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.913210 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.913212 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.913212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.913275 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.913538 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.913539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.913540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.913670 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.913852 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.913897 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.913979 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:01.914721 932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:01.915035 932 log.cc:824] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:01.916035 932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9: No bootstrap required, opened a new log
I20260811 16:47:01.916723 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:47:01.917709 654 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "507ca76794974affaa0900c0d8793260"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37148
I20260811 16:47:01.917881 654 raft_consensus.cc:482] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:47:01.917948 654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:01.918286 932 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } }
I20260811 16:47:01.918466 932 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ca0881324f949b1940a2ac0ff128af9, State: Initialized, Role: FOLLOWER
I20260811 16:47:01.918591 932 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } }
I20260811 16:47:01.918888 654 raft_consensus.cc:504] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } }
I20260811 16:47:01.918922 932 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:01.919178 654 leader_election.cc:288] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [CANDIDATE]: Term 1 election: Requested vote from peers 3ecbdfac0859416c9c70eb274297ab57 (127.27.186.125:33763), 3ca0881324f949b1940a2ac0ff128af9 (127.27.186.124:41643)
I20260811 16:47:01.919505 889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "507ca76794974affaa0900c0d8793260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3ca0881324f949b1940a2ac0ff128af9"
I20260811 16:47:01.919646 889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:01.920917 889 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 507ca76794974affaa0900c0d8793260 in term 1.
I20260811 16:47:01.921170 616 leader_election.cc:302] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ca0881324f949b1940a2ac0ff128af9, 507ca76794974affaa0900c0d8793260; no voters:
I20260811 16:47:01.921309 940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:01.921204 961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.921422 961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:01.921535 940 raft_consensus.cc:686] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [term 1 LEADER]: Becoming Leader. State: Replica: 507ca76794974affaa0900c0d8793260, State: Running, Role: LEADER
I20260811 16:47:01.921641 940 consensus_queue.cc:237] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } }
W20260811 16:47:01.921892 974 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:01.921940 974 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:01.922120 940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 507ca76794974affaa0900c0d8793260. Latest consensus state: current_term: 1 leader_uuid: "507ca76794974affaa0900c0d8793260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.922235 940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:01.924309 836 master_runner.cc:186] Error getting master registration for 127.27.186.125:33763: OK, instance_id { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" instance_seqno: 1786466821705365 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:47:01.926926 836 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:47:01.927381 978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:01.927670 978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:01.934242 703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.923703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37160 (local address 127.27.186.126:41807)
0811 16:47:01.924123 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.924126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.924139 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:47:01.924248 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.924250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.924261 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.924295 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.925101 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.925960 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.927282 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.927610 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.927685 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.929772 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.929774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.929774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.929782 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.932060 (+ 2278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.932848 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.932849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.932850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.932932 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.933282 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.933283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.933284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.933456 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.933614 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.934018 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.934132 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393}
I20260811 16:47:01.936528 938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.924219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52218 (local address 127.27.186.124:41643)
0811 16:47:01.924256 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.924258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.925783 (+ 1525us) server_negotiation.cc:407] Connection header received
0811 16:47:01.925883 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.925884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.925894 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.925922 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.926887 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.927616 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.931763 (+ 4147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.932069 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.932107 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.933584 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.933585 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.933586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.933593 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.935278 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.935692 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.935693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.935693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.935747 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.935943 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.935944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.935944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.936067 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.936157 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.936342 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.936421 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:47:01.938495 889 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [term 1 FOLLOWER]: Refusing update from remote peer 507ca76794974affaa0900c0d8793260: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:01.939079 975 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:01.940201 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.927061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55386 (local address 127.27.186.125:33763)
0811 16:47:01.927129 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.927132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.927141 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:01.927165 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.927166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.927178 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.927236 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.928380 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.929104 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.930153 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.930494 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.930538 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.937095 (+ 6557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.937097 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.937097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.937112 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.938962 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.939357 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.939358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.939359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.939412 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.939621 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.939622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.939622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.939752 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.939827 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.940021 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.940102 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 16:47:01.940856 961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 507ca76794974affaa0900c0d8793260. Latest consensus state: current_term: 1 leader_uuid: "507ca76794974affaa0900c0d8793260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.940958 961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:01.941011 825 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } attempt: 3
Aug 11 16:47:01 dist-test-slave-gsp7 krb5kdc[564](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466821, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
I20260811 16:47:01.947966 975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "507ca76794974affaa0900c0d8793260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.948086 975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:01.948401 978 catalog_manager.cc:1347] Generated new cluster ID: a6f065ed55874dd5af0110bffc091f87
I20260811 16:47:01.948451 978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:01.948768 961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "507ca76794974affaa0900c0d8793260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.948850 961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:01.950309 989 mvcc.cc:205] Tried to move back new op lower bound from 7317368102656155648 to 7317368102591815680. Current Snapshot: MvccSnapshot[applied={T|T < 7317368102656155648}]
I20260811 16:47:01.950747 988 mvcc.cc:205] Tried to move back new op lower bound from 7317368102656155648 to 7317368102591815680. Current Snapshot: MvccSnapshot[applied={T|T < 7317368102656155648 or (T in {7317368102656155648})}]
I20260811 16:47:01.952836 938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.941375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52222 (local address 127.27.186.124:41643)
0811 16:47:01.941408 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:01.941410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:01.941436 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:47:01.941453 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:01.941454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:01.941463 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:01.941529 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:01.941879 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.942600 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.943685 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.944004 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.944092 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.946800 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:01.946801 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:01.946801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:01.946808 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:01.951450 (+ 4642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.951908 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.951909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.951909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.951971 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:01.952245 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:01.952246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:01.952246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:01.952391 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:01.952460 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:01.952651 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 16:47:01.952738 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 16:47:01.952839 828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:01.941284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:41643 (local address 127.0.0.1:52222)
0811 16:47:01.941331 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:01.941342 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:01.941381 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:01.941580 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:01.941581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:01.941744 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:01.941779 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.941780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.942781 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.942782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.943597 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:01.943600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:01.944100 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:01.944101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:01.944161 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:01.944720 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:01.944727 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:01.946337 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:01.951561 (+ 5224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.951562 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.951563 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.951813 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.952088 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:01.952089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:01.952090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:01.952174 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:01.952477 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:01.952478 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:01.952540 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 16:47:01.952625 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 16:47:01.952739 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 16:47:01.954584 825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57: Bootstrap starting.
I20260811 16:47:01.955348 825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:01.955695 825 log.cc:824] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:01.956773 978 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 16:47:01.957558 978 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:01.970491 825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57: No bootstrap required, opened a new log
I20260811 16:47:01.972966 825 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } }
I20260811 16:47:01.973145 825 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ecbdfac0859416c9c70eb274297ab57, State: Initialized, Role: FOLLOWER
I20260811 16:47:01.973233 825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } }
I20260811 16:47:01.974957 825 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:01.975111 785 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "507ca76794974affaa0900c0d8793260" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3ecbdfac0859416c9c70eb274297ab57"
I20260811 16:47:01.975265 784 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:01.978024 784 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [term 1 FOLLOWER]: Refusing update from remote peer 507ca76794974affaa0900c0d8793260: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:01.978475 975 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:01.979678 785 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 507ca76794974affaa0900c0d8793260 in term 1.
I20260811 16:47:01.982584 978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260: Generated new TSK 0
I20260811 16:47:01.982810 978 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 16:47:01.983973 1018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "507ca76794974affaa0900c0d8793260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.984159 1018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:01.984268 1018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 507ca76794974affaa0900c0d8793260. Latest consensus state: current_term: 1 leader_uuid: "507ca76794974affaa0900c0d8793260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.984377 1018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:01.984454 1018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "507ca76794974affaa0900c0d8793260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.984570 1018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:01.985849 1024 catalog_manager.cc:1259] Loaded cluster ID: a6f065ed55874dd5af0110bffc091f87
I20260811 16:47:01.985952 1024 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57: loading cluster ID for follower catalog manager: success
I20260811 16:47:01.985899 940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "507ca76794974affaa0900c0d8793260" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "507ca76794974affaa0900c0d8793260" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 41807 } } peers { permanent_uuid: "3ecbdfac0859416c9c70eb274297ab57" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 33763 } } peers { permanent_uuid: "3ca0881324f949b1940a2ac0ff128af9" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 41643 } } }
I20260811 16:47:01.985997 940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 507ca76794974affaa0900c0d8793260 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:01.987432 1024 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57: acquiring CA information for follower catalog manager: success
I20260811 16:47:01.987913 1024 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3ecbdfac0859416c9c70eb274297ab57: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 16:47:02.022621 833 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.015617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55402 (local address 127.27.186.125:33763)
0811 16:47:02.015667 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.015669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.021691 (+ 6022us) server_negotiation.cc:407] Connection header received
0811 16:47:02.021804 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.021805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.021817 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.021849 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.022539 (+ 690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55402: BlockingRecv error: recv got EOF from 127.0.0.1:55402 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:47:02.023550 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.015935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52230 (local address 127.27.186.124:41643)
0811 16:47:02.015989 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.015991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.022196 (+ 6205us) server_negotiation.cc:407] Connection header received
0811 16:47:02.023057 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.023059 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.023072 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.023103 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.023481 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52230: BlockingRecv error: recv got EOF from 127.0.0.1:52230 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260811 16:47:02.028416 703 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.013427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37176 (local address 127.27.186.126:41807)
0811 16:47:02.013499 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.013502 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.019656 (+ 6154us) server_negotiation.cc:407] Connection header received
0811 16:47:02.019743 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.019745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.019757 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.019806 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.028345 (+ 8539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37176: BlockingRecv error: recv got EOF from 127.0.0.1:37176 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:02.041399 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.029625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55410 (local address 127.27.186.125:33763)
0811 16:47:02.029674 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.029676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.037784 (+ 8108us) server_negotiation.cc:407] Connection header received
0811 16:47:02.037835 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.037836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.037891 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.037954 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.038174 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.038976 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.040394 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.040691 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.040733 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.040986 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.041123 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.041176 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.041290 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.041312 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 16:47:02.045288 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.044362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52234 (local address 127.27.186.124:41643)
0811 16:47:02.044409 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.044411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.044685 (+ 274us) server_negotiation.cc:407] Connection header received
0811 16:47:02.044799 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.044800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.044820 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.044850 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.045225 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52234: BlockingRecv error: recv got EOF from 127.0.0.1:52234 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:02.073424 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.057499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55420 (local address 127.27.186.125:33763)
0811 16:47:02.057556 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.057559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.069752 (+ 12193us) server_negotiation.cc:407] Connection header received
0811 16:47:02.069894 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.069896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.069910 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.069946 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.070222 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.071094 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.072478 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.072808 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.072854 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.073111 (+ 257us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.073151 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.073182 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.073302 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.073325 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260811 16:47:02.088209 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.081522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52246 (local address 127.27.186.124:41643)
0811 16:47:02.081577 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.081579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.087517 (+ 5938us) server_negotiation.cc:407] Connection header received
0811 16:47:02.087607 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.087608 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.087623 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.087712 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.088140 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52246: BlockingRecv error: recv got EOF from 127.0.0.1:52246 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:02.101262 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.097824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55436 (local address 127.27.186.125:33763)
0811 16:47:02.097872 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.097874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.098195 (+ 321us) server_negotiation.cc:407] Connection header received
0811 16:47:02.098307 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.098308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.098319 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.098350 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.098565 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.099317 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.100419 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.100699 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.100743 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.100954 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.101004 (+ 50us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.101033 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.101141 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.101166 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 16:47:02.105389 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.104306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52254 (local address 127.27.186.124:41643)
0811 16:47:02.104352 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.104354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.104615 (+ 261us) server_negotiation.cc:407] Connection header received
0811 16:47:02.104719 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.104720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.104733 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.104764 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.105329 (+ 565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52254: BlockingRecv error: recv got EOF from 127.0.0.1:52254 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:02.114125 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.110781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55444 (local address 127.27.186.125:33763)
0811 16:47:02.110828 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.110830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.111052 (+ 222us) server_negotiation.cc:407] Connection header received
0811 16:47:02.111155 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.111156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.111166 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.111196 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.111381 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.112103 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.113221 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.113579 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.113629 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.113838 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.113873 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.113903 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.114029 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.114049 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 16:47:02.117740 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.116804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52264 (local address 127.27.186.124:41643)
0811 16:47:02.116847 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.116849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.117116 (+ 267us) server_negotiation.cc:407] Connection header received
0811 16:47:02.117221 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.117222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.117234 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.117265 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.117677 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52264: BlockingRecv error: recv got EOF from 127.0.0.1:52264 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:02.130510 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.127140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55452 (local address 127.27.186.125:33763)
0811 16:47:02.127183 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.127185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.127450 (+ 265us) server_negotiation.cc:407] Connection header received
0811 16:47:02.127559 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.127560 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.127571 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.127602 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.127790 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.128527 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.129681 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.129978 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.130040 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.130254 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.130288 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.130316 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.130419 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.130437 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 16:47:02.134675 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.133831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52280 (local address 127.27.186.124:41643)
0811 16:47:02.133875 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.133877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.134087 (+ 210us) server_negotiation.cc:407] Connection header received
0811 16:47:02.134125 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.134126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.134142 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.134205 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.134612 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52280: BlockingRecv error: recv got EOF from 127.0.0.1:52280 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 16:47:02.154951 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.151806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55464 (local address 127.27.186.125:33763)
0811 16:47:02.151853 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.151855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.151990 (+ 135us) server_negotiation.cc:407] Connection header received
0811 16:47:02.152034 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.152035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.152045 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.152129 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.152287 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.152999 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.154132 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.154414 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.154501 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.154675 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.154712 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.154773 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.154843 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.154867 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:47:02.158027 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.157270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52288 (local address 127.27.186.124:41643)
0811 16:47:02.157322 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.157324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.157469 (+ 145us) server_negotiation.cc:407] Connection header received
0811 16:47:02.157538 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.157539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.157552 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.157616 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.157972 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52288: BlockingRecv error: recv got EOF from 127.0.0.1:52288 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 16:47:02.193609 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.191319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55478 (local address 127.27.186.125:33763)
0811 16:47:02.191385 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.191387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.191490 (+ 103us) server_negotiation.cc:407] Connection header received
0811 16:47:02.191555 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.191556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.191566 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.191628 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.191751 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.192247 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.192963 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.193140 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.193190 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.193314 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.193342 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.193380 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.193443 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.193460 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 16:47:02.196026 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.195428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52296 (local address 127.27.186.124:41643)
0811 16:47:02.195483 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.195485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.195595 (+ 110us) server_negotiation.cc:407] Connection header received
0811 16:47:02.195630 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.195631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.195642 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.195684 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.195953 (+ 269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52296: BlockingRecv error: recv got EOF from 127.0.0.1:52296 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 16:47:02.263574 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.261322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55486 (local address 127.27.186.125:33763)
0811 16:47:02.261394 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.261396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.261445 (+ 49us) server_negotiation.cc:407] Connection header received
0811 16:47:02.261551 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.261552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.261560 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.261639 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.261767 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.262253 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.263012 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.263192 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.263245 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.263377 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.263404 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.263443 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.263496 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.263512 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 16:47:02.266235 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.265554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52308 (local address 127.27.186.124:41643)
0811 16:47:02.265602 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.265604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.265694 (+ 90us) server_negotiation.cc:407] Connection header received
0811 16:47:02.265762 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.265763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.265783 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.265848 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.266194 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52308: BlockingRecv error: recv got EOF from 127.0.0.1:52308 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:02.397923 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.395586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55500 (local address 127.27.186.125:33763)
0811 16:47:02.395678 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.395682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.395785 (+ 103us) server_negotiation.cc:407] Connection header received
0811 16:47:02.395850 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.395851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.395862 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.395905 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.396037 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.396517 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.397245 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.397424 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.397526 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.397678 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.397707 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.397748 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.397799 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.397817 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 16:47:02.400324 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.399721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52322 (local address 127.27.186.124:41643)
0811 16:47:02.399810 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.399812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.399821 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:02.399863 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.399863 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.399873 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.399921 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.400273 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52322: BlockingRecv error: recv got EOF from 127.0.0.1:52322 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 16:47:02.659873 833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:02.657613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55508 (local address 127.27.186.125:33763)
0811 16:47:02.657692 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.657694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.657734 (+ 40us) server_negotiation.cc:407] Connection header received
0811 16:47:02.657796 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.657797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.657806 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.657870 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:02.658064 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.658563 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.659306 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:02.659490 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:02.659542 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:02.659673 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:02.659700 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:02.659739 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:02.659796 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 16:47:02.659811 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 16:47:02.662343 938 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:02.661748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52324 (local address 127.27.186.124:41643)
0811 16:47:02.661795 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:02.661797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:02.661823 (+ 26us) server_negotiation.cc:407] Connection header received
0811 16:47:02.661878 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:02.661879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:02.661888 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:02.661935 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:02.662280 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52324: BlockingRecv error: recv got EOF from 127.0.0.1:52324 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:02.922399 974 catalog_manager.cc:1259] Loaded cluster ID: a6f065ed55874dd5af0110bffc091f87
I20260811 16:47:02.922511 974 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9: loading cluster ID for follower catalog manager: success
I20260811 16:47:02.923317 974 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9: acquiring CA information for follower catalog manager: success
I20260811 16:47:02.923643 974 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3ca0881324f949b1940a2ac0ff128af9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:47:03.178442 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:03.175631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55514 (local address 127.27.186.125:33763)
0811 16:47:03.175793 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:03.175795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:03.175883 (+ 88us) server_negotiation.cc:407] Connection header received
0811 16:47:03.175971 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:03.175972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:03.175986 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:03.176072 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:03.176222 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.176820 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.177701 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.177905 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.177976 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:03.178140 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:03.178184 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:03.178249 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:03.178312 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 16:47:03.178335 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":77,"threads_started":1}
I20260811 16:47:03.182667 1201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:03.180256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52326 (local address 127.27.186.124:41643)
0811 16:47:03.180386 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:03.180390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:03.180403 (+ 13us) server_negotiation.cc:407] Connection header received
0811 16:47:03.180427 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:03.180427 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:03.180477 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:03.180552 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:03.180637 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.181106 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.181803 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.182067 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.182138 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:03.182279 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:03.182408 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:03.182475 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:03.182515 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 16:47:03.182536 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260811 16:47:03.187394 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:03.184291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37190 (local address 127.27.186.126:41807)
0811 16:47:03.184412 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:03.184415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:03.184524 (+ 109us) server_negotiation.cc:407] Connection header received
0811 16:47:03.184668 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:03.184669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:03.184727 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:03.184791 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:03.185011 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.185792 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.186537 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.186756 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.186844 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:03.187046 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:03.187137 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:03.187212 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:03.187260 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 16:47:03.187284 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260811 16:47:03.187826 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:03.184403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55522 (local address 127.27.186.125:33763)
0811 16:47:03.184451 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:03.184452 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:03.184549 (+ 97us) server_negotiation.cc:407] Connection header received
0811 16:47:03.184670 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:03.184671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:03.184684 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:03.184754 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:03.184873 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.185637 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.186865 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.187197 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.187242 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:03.187530 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:03.187568 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:03.187600 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:03.187729 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 16:47:03.187752 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:47:03.187803 1201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:03.184547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52342 (local address 127.27.186.124:41643)
0811 16:47:03.184595 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:03.184598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:03.184606 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:03.184706 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:03.184707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:03.184719 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:03.184752 (+ 33us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:03.184995 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.185561 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.186874 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:03.187196 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:03.187241 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:03.187502 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:03.187535 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:03.187568 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:03.187707 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 16:47:03.187732 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 16:47:03.189352 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 587
I20260811 16:47:03.200735 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 710
I20260811 16:47:03.217357 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 836
2026-08-11T16:47:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3218 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 16:47:03 dist-test-slave-gsp7 krb5kdc[1214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 16:47:03 dist-test-slave-gsp7 krb5kdc[1214](info): set up 2 sockets
Aug 11 16:47:03 dist-test-slave-gsp7 krb5kdc[1214](info): commencing operation
krb5kdc: starting...
W20260811 16:47:04.508359 28393 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/test-user.keytab.
Aug 11 16:47:04 dist-test-slave-gsp7 krb5kdc[1214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T16:47:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T16:47:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.27.186.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
Entry for principal kudu/127.27.186.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab.
I20260811 16:47:04.635604 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:43517
--webserver_interface=127.27.186.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:43517,127.27.186.125:46807,127.27.186.124:45071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 16:47:04.720403 1234 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:47:04.720724 1234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:04.720754 1234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:04.720784 1234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:04.722602 1234 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:04.722680 1234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:04.722704 1234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:04.722738 1234 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:04.722764 1234 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:04.724969 1234 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:43517,127.27.186.125:46807,127.27.186.124:45071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.126.keytab
--principal=kudu/127.27.186.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.126:43517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.186.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:04.725265 1234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:04.725627 1234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:04.730502 1239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:04.730571 1244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:04.730515 1241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:04.730830 1234 server_base.cc:1034] running on GCE node
I20260811 16:47:04.731091 1234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:04.731401 1234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:04.732578 1234 hybrid_clock.cc:648] HybridClock initialized: now 1786466824732553 us; error 36 us; skew 500 ppm
Aug 11 16:47:04 dist-test-slave-gsp7 krb5kdc[1214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:04.735203 1234 init.cc:377] Logged in from keytab as kudu/127.27.186.126@KRBTEST.COM (short username kudu)
I20260811 16:47:04.735595 1234 webserver.cc:460] Webserver started at http://127.27.186.126:37139/ using document root <none> and password file <none>
I20260811 16:47:04.735774 1234 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:04.735814 1234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:04.735903 1234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:04.736944 1234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/data/instance:
uuid: "3835ed5a84fd46b1abc8157f34113a02"
format_stamp: "Formatted at 2026-08-11 16:47:04 on dist-test-slave-gsp7"
server_key: "b18f0f9bfbef9f8a8821caaaabf9a216"
server_key_iv: "c1f53c27e139fbe577ca42ec768610ef"
server_key_version: "encryptionkey@0"
I20260811 16:47:04.737268 1234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/wal/instance:
uuid: "3835ed5a84fd46b1abc8157f34113a02"
format_stamp: "Formatted at 2026-08-11 16:47:04 on dist-test-slave-gsp7"
server_key: "b18f0f9bfbef9f8a8821caaaabf9a216"
server_key_iv: "c1f53c27e139fbe577ca42ec768610ef"
server_key_version: "encryptionkey@0"
I20260811 16:47:04.738652 1234 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:04.739377 1255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:04.739548 1234 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 16:47:04.739636 1234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/wal
uuid: "3835ed5a84fd46b1abc8157f34113a02"
format_stamp: "Formatted at 2026-08-11 16:47:04 on dist-test-slave-gsp7"
server_key: "b18f0f9bfbef9f8a8821caaaabf9a216"
server_key_iv: "c1f53c27e139fbe577ca42ec768610ef"
server_key_version: "encryptionkey@0"
I20260811 16:47:04.739691 1234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:04.753389 1234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:04.755707 1234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:04.755820 1234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:04.759840 1234 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.126:43517
I20260811 16:47:04.759886 1334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.126:43517 every 8 connection(s)
I20260811 16:47:04.760262 1234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/data/info.pb
I20260811 16:47:04.761180 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 1234
I20260811 16:47:04.761262 1335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:04.761297 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-0/wal/instance
I20260811 16:47:04.761538 28393 external_mini_cluster.cc:1428] Setting key 9ba525b1d1c5b5a0a20be08081d3883c
I20260811 16:47:04.763736 1335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.27.186.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.125@KRBTEST.COM" created.
Aug 11 16:47:04 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:47:04.776450 1341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.764462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57980 (local address 127.27.186.126:43517)
0811 16:47:04.764686 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:04.764691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:04.764774 (+ 83us) server_negotiation.cc:407] Connection header received
0811 16:47:04.765323 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:04.765325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:04.765344 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:04.765468 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:04.766087 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.766907 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.767764 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.768090 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.768211 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:04.772900 (+ 4689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:04.772910 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:04.772910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:04.772918 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:04.774713 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:04.775198 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:04.775200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:04.775201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:04.775278 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:04.775533 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:04.775534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:04.775534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:04.775739 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:04.775801 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:04.776078 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 16:47:04.776206 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":92,"threads_started":1}
I20260811 16:47:04.776538 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.764436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:43517 (local address 127.0.0.1:57980)
0811 16:47:04.764615 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.764659 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:04.765159 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:04.765474 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:04.765497 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:04.765774 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:04.765983 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:04.765988 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.767012 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.767013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:04.767675 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:04.767677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.768181 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.768182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:04.768247 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:04.768800 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:04.768808 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:04.772793 (+ 3985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:04.774802 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:04.774810 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:04.774812 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:04.775108 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:04.775347 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:04.775348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:04.775348 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:04.775465 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:04.775813 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:04.775823 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:04.775923 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 16:47:04.776036 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 16:47:04.776317 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":96,"thread_start_us":103,"threads_started":1}
I20260811 16:47:04.777323 1335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:04.777736 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.777587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57162)
0811 16:47:04.777644 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.777701 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:47:04.777891 1261 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
I20260811 16:47:04.778411 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.778311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57168)
0811 16:47:04.778366 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.778393 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 16:47:04.778553 1335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:46807: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab.
Entry for principal kudu/127.27.186.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab.
I20260811 16:47:04.788663 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.125:46807
--webserver_interface=127.27.186.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab
--principal=kudu/127.27.186.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:43517,127.27.186.125:46807,127.27.186.124:45071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:47:04.827862 1335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } attempt: 1
I20260811 16:47:04.828482 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.828326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57174)
0811 16:47:04.828402 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.828450 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 16:47:04.828879 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.828791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57176)
0811 16:47:04.828836 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.828862 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 16:47:04.829023 1335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:46807: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
W20260811 16:47:04.873078 1345 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:47:04.873299 1345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:04.873317 1345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:04.873338 1345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:04.874563 1345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:04.874609 1345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:04.874624 1345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:04.874636 1345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:04.874650 1345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:04.876183 1345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:43517,127.27.186.125:46807,127.27.186.124:45071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.125.keytab
--principal=kudu/127.27.186.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.125:46807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.186.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:04.876447 1345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:04.876699 1345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:04.881614 1355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:04.881764 1350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:04.881764 1351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:04.881994 1345 server_base.cc:1034] running on GCE node
I20260811 16:47:04.882293 1345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:04.882601 1345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:04.883770 1345 hybrid_clock.cc:648] HybridClock initialized: now 1786466824883765 us; error 39 us; skew 500 ppm
Aug 11 16:47:04 dist-test-slave-gsp7 krb5kdc[1214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:04.886435 1345 init.cc:377] Logged in from keytab as kudu/127.27.186.125@KRBTEST.COM (short username kudu)
I20260811 16:47:04.886940 1345 webserver.cc:460] Webserver started at http://127.27.186.125:34323/ using document root <none> and password file <none>
I20260811 16:47:04.887177 1345 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:04.887246 1345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:04.887400 1345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:04.888513 1345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/data/instance:
uuid: "c4df507da0c54c6d90e285d93fd68041"
format_stamp: "Formatted at 2026-08-11 16:47:04 on dist-test-slave-gsp7"
server_key: "e658b821c53c6c488d7d57b2d0127842"
server_key_iv: "4084403971a8156dac14d1eb1684944f"
server_key_version: "encryptionkey@0"
I20260811 16:47:04.888900 1345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/wal/instance:
uuid: "c4df507da0c54c6d90e285d93fd68041"
format_stamp: "Formatted at 2026-08-11 16:47:04 on dist-test-slave-gsp7"
server_key: "e658b821c53c6c488d7d57b2d0127842"
server_key_iv: "4084403971a8156dac14d1eb1684944f"
server_key_version: "encryptionkey@0"
I20260811 16:47:04.890409 1345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 16:47:04.891297 1367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:04.891613 1345 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 16:47:04.891727 1345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/wal
uuid: "c4df507da0c54c6d90e285d93fd68041"
format_stamp: "Formatted at 2026-08-11 16:47:04 on dist-test-slave-gsp7"
server_key: "e658b821c53c6c488d7d57b2d0127842"
server_key_iv: "4084403971a8156dac14d1eb1684944f"
server_key_version: "encryptionkey@0"
I20260811 16:47:04.891808 1345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:04.897182 1335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } attempt: 2
I20260811 16:47:04.897696 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.897569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57184)
0811 16:47:04.897626 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.897664 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:47:04.898066 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.897969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57192)
0811 16:47:04.898014 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.898042 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 16:47:04.898162 1335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.125:46807: Network error: Client connection negotiation failed: client connection to 127.27.186.125:46807: connect: Connection refused (error 111)
I20260811 16:47:04.904477 1345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:04.906876 1345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:04.907048 1345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:04.911249 1345 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.125:46807
I20260811 16:47:04.911281 1437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.125:46807 every 8 connection(s)
I20260811 16:47:04.911656 1345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/data/info.pb
I20260811 16:47:04.912528 1439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:04.914175 1439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:04.914788 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 1345
I20260811 16:47:04.914925 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-1/wal/instance
I20260811 16:47:04.915155 28393 external_mini_cluster.cc:1428] Setting key cc72920bef164662a7577d98fa385268
Aug 11 16:47:04 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:47:04.924245 1341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.914934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57996 (local address 127.27.186.126:43517)
0811 16:47:04.914991 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:04.914994 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:04.915255 (+ 261us) server_negotiation.cc:407] Connection header received
0811 16:47:04.916009 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:04.916010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:04.916024 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:04.916067 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:04.916917 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.917391 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.918424 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.918653 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.918735 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:04.921270 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:04.921271 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:04.921271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:04.921278 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:04.922730 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:04.923234 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:04.923235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:04.923235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:04.923286 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:04.923584 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:04.923584 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:04.923584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:04.923689 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:04.923741 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:04.924107 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 16:47:04.924177 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
WARNING: no policy specified for kudu/127.27.186.124@KRBTEST.COM; defaulting to no policy
I20260811 16:47:04.924485 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.914881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:43517 (local address 127.0.0.1:57996)
0811 16:47:04.915097 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.915150 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:04.915884 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:04.916139 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:04.916148 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:04.916547 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:04.916826 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:04.916832 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.917525 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.917527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:04.918322 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:04.918325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.918748 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.918749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:04.918873 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:04.919434 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:04.919442 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:04.921170 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:04.922822 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:04.922830 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:04.922832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:04.923147 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:04.923351 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:04.923352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:04.923353 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:04.923501 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:04.923759 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:04.923767 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:04.923952 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 16:47:04.924080 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 16:47:04.924257 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":90,"threads_started":1}
I20260811 16:47:04.925093 1439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.27.186.124@KRBTEST.COM" created.
Aug 11 16:47:04 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:47:04.932814 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.925366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57202)
0811 16:47:04.925419 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.925430 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:04.925470 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:04.925809 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:04.925810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:04.925950 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:04.925994 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:04.925995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.926909 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.926910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:04.927488 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:04.927491 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.928124 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.928125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:04.928186 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:04.928641 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:04.928645 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:04.929842 (+ 1197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:04.931635 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:04.931636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:04.931636 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:04.931879 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:04.932136 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:04.932137 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:04.932137 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:04.932211 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:04.932497 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:04.932499 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:04.932553 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 16:47:04.932633 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 16:47:04.932748 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 16:47:04.932961 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.925450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57202 (local address 127.27.186.125:46807)
0811 16:47:04.925673 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:04.925676 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:04.925693 (+ 17us) server_negotiation.cc:407] Connection header received
0811 16:47:04.925711 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:04.925712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:04.925723 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:04.925810 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:04.926083 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.926803 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.927575 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.928035 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.928113 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:04.929927 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:04.929936 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:04.929937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:04.929945 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:04.931540 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:04.931981 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:04.931984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:04.931985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:04.932059 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:04.932281 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:04.932282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:04.932282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:04.932422 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:04.932487 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:04.932693 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 16:47:04.932825 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":189,"thread_start_us":110,"threads_started":1}
I20260811 16:47:04.933640 1439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:04.934022 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.933877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46420)
0811 16:47:04.933939 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.933994 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 16:47:04.934151 1368 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
I20260811 16:47:04.934634 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.934529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46422)
0811 16:47:04.934579 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.934611 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:47:04.934774 1439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:45071: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.27.186.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab.
Entry for principal kudu/127.27.186.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab.
I20260811 16:47:04.944547 28393 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJargcS/build/release/bin/kudu
/tmp/dist-test-taskJargcS/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.124:45071
--webserver_interface=127.27.186.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab
--principal=kudu/127.27.186.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.27.186.84:33973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.186.126:43517,127.27.186.125:46807,127.27.186.124:45071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 16:47:04.984035 1439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } attempt: 1
I20260811 16:47:04.984580 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.984404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46436)
0811 16:47:04.984478 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.984539 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 16:47:04.984980 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.984881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46444)
0811 16:47:04.984928 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.984958 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 16:47:04.985100 1439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:45071: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
I20260811 16:47:04.989312 1335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } attempt: 3
Aug 11 16:47:04 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:47:04.996541 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.989658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57204)
0811 16:47:04.989722 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.989735 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:04.989805 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:04.989966 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:04.989968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:04.990157 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:04.990225 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:04.990227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.990910 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.990912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:04.991465 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:04.991467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.991870 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.991871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:04.991954 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:04.992479 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:04.992484 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:04.993706 (+ 1222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:04.995366 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:04.995367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:04.995367 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:04.995615 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:04.995861 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:04.995861 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:04.995862 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:04.995922 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:04.996192 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:04.996193 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:04.996242 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 16:47:04.996331 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 16:47:04.996436 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 16:47:04.996541 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.989725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57204 (local address 127.27.186.125:46807)
0811 16:47:04.989790 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:04.989792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:04.989804 (+ 12us) server_negotiation.cc:407] Connection header received
0811 16:47:04.989875 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:04.989876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:04.989888 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:04.989972 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:04.990309 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.990821 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.991554 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:04.991790 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:04.991870 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:04.993801 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:04.993804 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:04.993804 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:04.993817 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:04.995236 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:04.995698 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:04.995699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:04.995700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:04.995765 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:04.995995 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:04.995996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:04.995997 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:04.996119 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:04.996203 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:04.996357 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 16:47:04.996436 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 16:47:04.996888 1335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } has no permanent_uuid. Determining permanent_uuid...
I20260811 16:47:04.997290 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.997189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46456)
0811 16:47:04.997239 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.997269 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 16:47:04.997654 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:04.997562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46462)
0811 16:47:04.997605 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:04.997630 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 16:47:04.997750 1335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:45071: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
I20260811 16:47:05.028891 1335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } attempt: 1
I20260811 16:47:05.029373 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.029233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46478)
0811 16:47:05.029300 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.029340 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 16:47:05.029809 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.029714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46490)
0811 16:47:05.029762 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.029790 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 16:47:05.029891 1335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:45071: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
W20260811 16:47:05.030033 1450 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 16:47:05.030265 1450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 16:47:05.030321 1450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 16:47:05.030364 1450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 16:47:05.031530 1450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 16:47:05.031598 1450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 16:47:05.031625 1450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 16:47:05.031652 1450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 16:47:05.031679 1450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 16:47:05.033162 1450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.186.84:33973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.27.186.126:43517,127.27.186.125:46807,127.27.186.124:45071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/krb5kdc/kudu_127.27.186.124.keytab
--principal=kudu/127.27.186.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.186.124:45071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.186.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 12:59:11 UTC on ccycloud.quasar-gyrooa.root.comops.site
build id 4580407
I20260811 16:47:05.033437 1450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 16:47:05.033689 1450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 16:47:05.038650 1460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:05.038671 1463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 16:47:05.038640 1461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 16:47:05.038731 1450 server_base.cc:1034] running on GCE node
I20260811 16:47:05.039052 1450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 16:47:05.039304 1450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 16:47:05.040479 1450 hybrid_clock.cc:648] HybridClock initialized: now 1786466825040458 us; error 30 us; skew 500 ppm
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466825, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 16:47:05.043040 1450 init.cc:377] Logged in from keytab as kudu/127.27.186.124@KRBTEST.COM (short username kudu)
I20260811 16:47:05.043498 1450 webserver.cc:460] Webserver started at http://127.27.186.124:44211/ using document root <none> and password file <none>
I20260811 16:47:05.043741 1450 fs_manager.cc:359] Metadata directory not provided
I20260811 16:47:05.043810 1450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 16:47:05.043967 1450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 16:47:05.045037 1450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/data/instance:
uuid: "e8ebe0056c9d486cbd1610eda485ee64"
format_stamp: "Formatted at 2026-08-11 16:47:05 on dist-test-slave-gsp7"
server_key: "1b74359b265a969e8d24c6b92c7c6f09"
server_key_iv: "effd09d5decb7545ca16192a990019c3"
server_key_version: "encryptionkey@0"
I20260811 16:47:05.045418 1450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/wal/instance:
uuid: "e8ebe0056c9d486cbd1610eda485ee64"
format_stamp: "Formatted at 2026-08-11 16:47:05 on dist-test-slave-gsp7"
server_key: "1b74359b265a969e8d24c6b92c7c6f09"
server_key_iv: "effd09d5decb7545ca16192a990019c3"
server_key_version: "encryptionkey@0"
I20260811 16:47:05.046813 1450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 16:47:05.047524 1470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 16:47:05.047700 1450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 16:47:05.047816 1450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/data,/tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/wal
uuid: "e8ebe0056c9d486cbd1610eda485ee64"
format_stamp: "Formatted at 2026-08-11 16:47:05 on dist-test-slave-gsp7"
server_key: "1b74359b265a969e8d24c6b92c7c6f09"
server_key_iv: "effd09d5decb7545ca16192a990019c3"
server_key_version: "encryptionkey@0"
I20260811 16:47:05.047901 1450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 16:47:05.053272 1439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } attempt: 2
I20260811 16:47:05.053716 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.053595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46500)
0811 16:47:05.053650 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.053688 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 16:47:05.054061 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.053953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46512)
0811 16:47:05.053998 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.054035 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 16:47:05.054144 1439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.27.186.124:45071: Network error: Client connection negotiation failed: client connection to 127.27.186.124:45071: connect: Connection refused (error 111)
I20260811 16:47:05.064951 1450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 16:47:05.067065 1450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 16:47:05.067245 1450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 16:47:05.071513 1450 rpc_server.cc:307] RPC server started. Bound to: 127.27.186.124:45071
I20260811 16:47:05.071568 1561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.27.186.124:45071 every 8 connection(s)
I20260811 16:47:05.071957 1450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/data/info.pb
I20260811 16:47:05.072885 1562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 16:47:05.074579 1562 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466825, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
I20260811 16:47:05.080379 28393 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJargcS/build/release/bin/kudu as pid 1450
I20260811 16:47:05.080503 28393 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJargcS/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786466533930122-28393-0/minicluster-data/master-2/wal/instance
I20260811 16:47:05.080731 28393 external_mini_cluster.cc:1428] Setting key 315e1fb10c70bcb4a70eec9306564523
I20260811 16:47:05.084074 1341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.075346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58008 (local address 127.27.186.126:43517)
0811 16:47:05.075420 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.075422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.075607 (+ 185us) server_negotiation.cc:407] Connection header received
0811 16:47:05.076073 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.076074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.076083 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.076146 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.076753 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.077236 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.078334 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.078514 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.078571 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.080849 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.080851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.080851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.080859 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.082622 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.083069 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.083071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.083071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.083135 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.083405 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.083406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.083406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.083527 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.083603 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.083886 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.083980 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:47:05.084275 1567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.075297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.126:43517 (local address 127.0.0.1:58008)
0811 16:47:05.075464 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.075508 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:05.075989 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:05.076216 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:05.076219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:05.076467 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:05.076669 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.076673 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.077316 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.077317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.078257 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.078260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.078587 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.078588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.078685 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.079228 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:05.079236 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:05.080731 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:05.082742 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.082750 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.082752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.082986 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.083213 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.083214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.083215 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.083335 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.083608 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:05.083615 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:05.083752 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 16:47:05.083864 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 16:47:05.084021 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260811 16:47:05.085002 1562 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466825, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:47:05.089838 1570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.081130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46524 (local address 127.27.186.124:45071)
0811 16:47:05.081297 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.081301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.081464 (+ 163us) server_negotiation.cc:407] Connection header received
0811 16:47:05.081542 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.081546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.081559 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.081633 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.082245 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.082913 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.083673 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.083988 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.084071 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.086802 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.086809 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.086809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.086815 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.088565 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.088901 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.088904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.088905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.088973 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.089194 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.089195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.089195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.089326 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.089535 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.089638 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.089718 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
I20260811 16:47:05.092404 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.085379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57214 (local address 127.27.186.125:46807)
0811 16:47:05.085437 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.085439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.085448 (+ 9us) server_negotiation.cc:407] Connection header received
0811 16:47:05.085495 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.085496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.085507 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.085577 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.085849 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.086293 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.087124 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.087393 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.087492 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.089414 (+ 1922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.089416 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.089416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.089423 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.091230 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.091566 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.091567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.091568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.091630 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.091836 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.091837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.091837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.091990 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.092054 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.092233 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.092311 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 16:47:05.092643 1567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.085285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.125:46807 (local address 127.0.0.1:57214)
0811 16:47:05.085327 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.085336 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:05.085370 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:05.085584 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:05.085584 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:05.085694 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:05.085739 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.085740 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.086390 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.086391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.087063 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.087065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.087494 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.087495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.087572 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.088049 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:05.088053 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:05.089322 (+ 1269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:05.091298 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.091299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.091299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.091477 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.091703 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.091704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.091704 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.091768 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.092082 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:05.092083 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:05.092124 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 16:47:05.092474 (+ 350us) client_negotiation.cc:240] Negotiation successful
0811 16:47:05.092557 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 16:47:05.093072 1562 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.126@KRBTEST.COM
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466825, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.124@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
I20260811 16:47:05.100147 1341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.090725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58010 (local address 127.27.186.126:43517)
0811 16:47:05.091229 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.091232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.091242 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:05.091265 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.091266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.091276 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.091333 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.091956 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.092654 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.093691 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.093983 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.094025 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.096668 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.096670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.096670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.096677 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.098349 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.098784 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.098785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.098786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.098835 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.099038 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.099039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.099039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.099137 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.099933 (+ 796us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.099985 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.100073 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479}
I20260811 16:47:05.100477 1567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.093382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46528)
0811 16:47:05.093504 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.093513 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:05.093550 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:05.093759 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:05.093760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:05.093895 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:05.093920 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.093921 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.094844 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.094844 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.095314 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.095316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.095734 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.095735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.095792 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.096119 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:05.096124 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:05.097600 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:05.099346 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.099347 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.099348 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.099623 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.099891 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.099892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.099892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.099961 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.100192 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:05.100193 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:05.100238 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 16:47:05.100309 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 16:47:05.100391 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 16:47:05.100760 1570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.093407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46528 (local address 127.27.186.124:45071)
0811 16:47:05.093454 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.093456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.093596 (+ 140us) server_negotiation.cc:407] Connection header received
0811 16:47:05.093654 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.093655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.093690 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.093732 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.094051 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.094762 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.095376 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.095658 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.095712 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.097704 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.097705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.097705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.097712 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.099257 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.099754 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.099755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.099756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.099810 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.100029 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.100030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.100030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.100124 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.100175 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.100604 (+ 429us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.100683 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 16:47:05.102428 1562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64: Bootstrap starting.
I20260811 16:47:05.103421 1562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:05.103777 1562 log.cc:824] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:05.104660 1562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64: No bootstrap required, opened a new log
I20260811 16:47:05.105012 1335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } attempt: 2
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.27.186.125@KRBTEST.COM
I20260811 16:47:05.106876 1562 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } }
I20260811 16:47:05.107057 1562 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ebe0056c9d486cbd1610eda485ee64, State: Initialized, Role: FOLLOWER
I20260811 16:47:05.107161 1562 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } }
I20260811 16:47:05.107520 1562 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:05.107472 1573 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.107681 1573 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:05.109468 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.100809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57228 (local address 127.27.186.125:46807)
0811 16:47:05.100848 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.100851 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.100875 (+ 24us) server_negotiation.cc:407] Connection header received
0811 16:47:05.100897 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.100897 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.100906 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.100948 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.101595 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.102039 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.102920 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.103634 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.103694 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.106198 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.106199 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.106200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.106207 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.107942 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.108409 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.108410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.108411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.108481 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.108714 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.108715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.108716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.108870 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.109240 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.109288 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.109375 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.126@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
W20260811 16:47:05.110069 1597 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:05.110121 1597 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:05.111049 28393 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 16:47:05.110502 1450 master_runner.cc:186] Error getting master registration for 127.27.186.126:43517: OK, instance_id { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" instance_seqno: 1786466824758633 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:47:05.113538 1450 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:47:05.112690 1301 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3835ed5a84fd46b1abc8157f34113a02"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58010
I20260811 16:47:05.114847 1340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.105891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46536)
0811 16:47:05.105951 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.105961 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:05.106007 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:05.106133 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:05.106133 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:05.106283 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:05.106320 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.106322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.107093 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.107094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.107859 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.107862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.108293 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.108294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.108353 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.108757 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:05.108762 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:05.110940 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:05.112801 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.112802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.112802 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.112981 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.113194 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.113195 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.113196 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.113259 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.114508 (+ 1249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:05.114509 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:05.114561 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 16:47:05.114641 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 16:47:05.114746 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 16:47:05.114864 1570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.105902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46536 (local address 127.27.186.124:45071)
0811 16:47:05.105942 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.105944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.105992 (+ 48us) server_negotiation.cc:407] Connection header received
0811 16:47:05.106063 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.106064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.106073 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.106128 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.106396 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.106990 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.107942 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.108230 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.108295 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.111045 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.111046 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.111046 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.111053 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.112711 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.113056 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.113057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.113058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.113110 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.113333 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.113334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.113334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.113519 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.113583 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.114686 (+ 1103us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.114769 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 16:47:05.116343 1335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02: Bootstrap starting.
I20260811 16:47:05.117110 1335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:05.117417 1335 log.cc:824] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:05.118324 1335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02: No bootstrap required, opened a new log
I20260811 16:47:05.119736 1335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } }
I20260811 16:47:05.119882 1335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3835ed5a84fd46b1abc8157f34113a02, State: Initialized, Role: FOLLOWER
I20260811 16:47:05.119972 1335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } }
I20260811 16:47:05.120235 1604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.120287 1335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:05.120384 1301 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 16:47:05.120445 1301 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:05.121274 1301 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } }
I20260811 16:47:05.121814 1604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:05.122084 1301 leader_election.cc:288] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [CANDIDATE]: Term 1 election: Requested vote from peers c4df507da0c54c6d90e285d93fd68041 (127.27.186.125:46807), e8ebe0056c9d486cbd1610eda485ee64 (127.27.186.124:45071)
I20260811 16:47:05.122397 1514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3835ed5a84fd46b1abc8157f34113a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e8ebe0056c9d486cbd1610eda485ee64"
I20260811 16:47:05.122534 1514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [term 0 FOLLOWER]: Advancing to term 1
W20260811 16:47:05.122851 1620 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:05.122972 1620 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:05.123512 1514 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3835ed5a84fd46b1abc8157f34113a02 in term 1.
I20260811 16:47:05.123741 1256 leader_election.cc:302] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3835ed5a84fd46b1abc8157f34113a02, e8ebe0056c9d486cbd1610eda485ee64; no voters:
I20260811 16:47:05.123873 1604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 16:47:05.124078 1604 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [term 1 LEADER]: Becoming Leader. State: Replica: 3835ed5a84fd46b1abc8157f34113a02, State: Running, Role: LEADER
I20260811 16:47:05.124186 1604 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } }
I20260811 16:47:05.124769 1628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3835ed5a84fd46b1abc8157f34113a02. Latest consensus state: current_term: 1 leader_uuid: "3835ed5a84fd46b1abc8157f34113a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.124980 1628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:05.123049 1234 master_runner.cc:186] Error getting master registration for 127.27.186.125:46807: OK, instance_id { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" instance_seqno: 1786466824910063 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 16:47:05.125248 1234 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 16:47:05.132123 1637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 16:47:05.133299 1341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.123864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58014 (local address 127.27.186.126:43517)
0811 16:47:05.123906 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.123908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.124694 (+ 786us) server_negotiation.cc:407] Connection header received
0811 16:47:05.124793 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.124794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.124804 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.124834 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.125846 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.126534 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.127730 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.128028 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.128069 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.129701 (+ 1632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.129703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.129703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.129709 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.131555 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.132160 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.132162 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.132162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.132232 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.132591 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.132592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.132593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.132722 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.132804 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.133125 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.133205 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 16:47:05.133391 1637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 16:47:05.134373 1570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.124050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46552 (local address 127.27.186.124:45071)
0811 16:47:05.124118 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.124120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.125742 (+ 1622us) server_negotiation.cc:407] Connection header received
0811 16:47:05.125838 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.125839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.125849 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.125879 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.127546 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.128221 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.129216 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.129563 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.129612 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.131392 (+ 1780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.131393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.131394 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.131400 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.133075 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.133538 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.133540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.133540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.133594 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.133795 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.133796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.133797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.133925 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.133999 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.134220 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.134298 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 16:47:05.135787 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.124264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57232 (local address 127.27.186.125:46807)
0811 16:47:05.124306 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.124308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.124710 (+ 402us) server_negotiation.cc:407] Connection header received
0811 16:47:05.124821 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.124822 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.124834 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.124865 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.125664 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.126446 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.127525 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.127839 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.127902 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.131142 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.131144 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.131144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.131151 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.133199 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.134890 (+ 1691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.134892 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.134892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.134961 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.135182 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.135183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.135184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.135297 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.135395 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.135540 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.135621 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:05.141516 1514 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [term 1 FOLLOWER]: Refusing update from remote peer 3835ed5a84fd46b1abc8157f34113a02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:05.142181 1628 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:05.143673 1573 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3835ed5a84fd46b1abc8157f34113a02. Latest consensus state: current_term: 1 leader_uuid: "3835ed5a84fd46b1abc8157f34113a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.143772 1573 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:05.144800 1628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3835ed5a84fd46b1abc8157f34113a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.144888 1628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:05.144963 1573 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3835ed5a84fd46b1abc8157f34113a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.145047 1573 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:05.145183 1638 mvcc.cc:205] Tried to move back new op lower bound from 7317368115776028672 to 7317368115709513728. Current Snapshot: MvccSnapshot[applied={T|T < 7317368115776028672}]
I20260811 16:47:05.145247 1639 mvcc.cc:205] Tried to move back new op lower bound from 7317368115776028672 to 7317368115709513728. Current Snapshot: MvccSnapshot[applied={T|T < 7317368115776028672}]
I20260811 16:47:05.145267 1439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } attempt: 3
Aug 11 16:47:05 dist-test-slave-gsp7 krb5kdc[1214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786466824, etypes {rep=17 tkt=17 ses=17}, kudu/127.27.186.125@KRBTEST.COM for kudu/127.27.186.124@KRBTEST.COM
I20260811 16:47:05.152561 1637 catalog_manager.cc:1347] Generated new cluster ID: 0786cb12542543c598694fe5efeb0db9
I20260811 16:47:05.152626 1637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 16:47:05.154762 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.145705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.27.186.124:45071 (local address 127.0.0.1:46564)
0811 16:47:05.145825 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 16:47:05.145837 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 16:47:05.145885 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 16:47:05.146186 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 16:47:05.146187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 16:47:05.146375 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 16:47:05.146424 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.146426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.147375 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.147400 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.148193 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 16:47:05.148196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.148731 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.148732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 16:47:05.148813 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.149312 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 16:47:05.149317 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 16:47:05.151112 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 16:47:05.153704 (+ 2592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.153705 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.153706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.153921 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.154134 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 16:47:05.154134 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 16:47:05.154134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 16:47:05.154185 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 16:47:05.154455 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 16:47:05.154456 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 16:47:05.154511 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 16:47:05.154570 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 16:47:05.154662 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260811 16:47:05.154785 1570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:05.145622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46564 (local address 127.27.186.124:45071)
0811 16:47:05.145663 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.145665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.146085 (+ 420us) server_negotiation.cc:407] Connection header received
0811 16:47:05.146106 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.146107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.146117 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.146179 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.146501 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.147268 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.148298 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:05.148634 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:05.148708 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:05.151564 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 16:47:05.151566 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 16:47:05.151566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 16:47:05.151574 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 16:47:05.153627 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.154007 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.154008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.154008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.154073 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 16:47:05.154241 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 16:47:05.154242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 16:47:05.154242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 16:47:05.154375 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 16:47:05.154447 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:05.154612 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 16:47:05.154695 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 16:47:05.156680 1439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041: Bootstrap starting.
I20260811 16:47:05.157665 1439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041: Neither blocks nor log segments found. Creating new log.
I20260811 16:47:05.158005 1439 log.cc:824] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041: Log is configured to *not* fsync() on all Append() calls
I20260811 16:47:05.159047 1439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041: No bootstrap required, opened a new log
I20260811 16:47:05.161127 1439 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } }
I20260811 16:47:05.161278 1439 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4df507da0c54c6d90e285d93fd68041, State: Initialized, Role: FOLLOWER
I20260811 16:47:05.161361 1439 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } }
I20260811 16:47:05.161743 1439 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 16:47:05.161805 1406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3835ed5a84fd46b1abc8157f34113a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c4df507da0c54c6d90e285d93fd68041"
I20260811 16:47:05.161912 1406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [term 0 FOLLOWER]: Advancing to term 1
I20260811 16:47:05.162709 1406 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3835ed5a84fd46b1abc8157f34113a02 in term 1.
I20260811 16:47:05.163188 1405 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [term 1 FOLLOWER]: Refusing update from remote peer 3835ed5a84fd46b1abc8157f34113a02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 16:47:05.163511 1604 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 16:47:05.171880 1648 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3835ed5a84fd46b1abc8157f34113a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.171986 1648 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:05.172043 1648 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3835ed5a84fd46b1abc8157f34113a02. Latest consensus state: current_term: 1 leader_uuid: "3835ed5a84fd46b1abc8157f34113a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.172094 1648 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:05.172127 1648 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3835ed5a84fd46b1abc8157f34113a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.172170 1648 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 16:47:05.172739 1637 catalog_manager.cc:1370] Generated new certificate authority record
W20260811 16:47:05.172955 1664 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 16:47:05.173017 1664 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 16:47:05.173504 1637 catalog_manager.cc:1504] Loading token signing keys...
I20260811 16:47:05.173466 1667 mvcc.cc:205] Tried to move back new op lower bound from 7317368115776028672 to 7317368115709513728. Current Snapshot: MvccSnapshot[applied={T|T < 7317368115776028672}]
I20260811 16:47:05.174329 1628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3835ed5a84fd46b1abc8157f34113a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3835ed5a84fd46b1abc8157f34113a02" member_type: VOTER last_known_addr { host: "127.27.186.126" port: 43517 } } peers { permanent_uuid: "c4df507da0c54c6d90e285d93fd68041" member_type: VOTER last_known_addr { host: "127.27.186.125" port: 46807 } } peers { permanent_uuid: "e8ebe0056c9d486cbd1610eda485ee64" member_type: VOTER last_known_addr { host: "127.27.186.124" port: 45071 } } }
I20260811 16:47:05.174425 1628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02 [sys.catalog]: This master's current role is: LEADER
I20260811 16:47:05.183935 1637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3835ed5a84fd46b1abc8157f34113a02: Generated new TSK 0
I20260811 16:47:05.184141 1637 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 16:47:05.215358 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.213571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57236 (local address 127.27.186.125:46807)
0811 16:47:05.213621 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.213623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.214620 (+ 997us) server_negotiation.cc:407] Connection header received
0811 16:47:05.214735 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.214736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.214748 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.214779 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.215279 (+ 500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57236: BlockingRecv error: recv got EOF from 127.0.0.1:57236 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 16:47:05.216179 1341 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.214033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58028 (local address 127.27.186.126:43517)
0811 16:47:05.214076 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.214078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.215627 (+ 1549us) server_negotiation.cc:407] Connection header received
0811 16:47:05.215728 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.215729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.215741 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.215773 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.216114 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58028: BlockingRecv error: recv got EOF from 127.0.0.1:58028 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:47:05.216939 1570 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.214344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46576 (local address 127.27.186.124:45071)
0811 16:47:05.214386 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.214388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.216393 (+ 2005us) server_negotiation.cc:407] Connection header received
0811 16:47:05.216526 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.216528 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.216538 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.216568 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.216877 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46576: BlockingRecv error: recv got EOF from 127.0.0.1:46576 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 16:47:05.219324 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.218197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57238 (local address 127.27.186.125:46807)
0811 16:47:05.218247 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.218248 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.218793 (+ 545us) server_negotiation.cc:407] Connection header received
0811 16:47:05.218924 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.218925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.218945 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.218976 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.219274 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57238: BlockingRecv error: recv got EOF from 127.0.0.1:57238 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 16:47:05.222605 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.221684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57244 (local address 127.27.186.125:46807)
0811 16:47:05.221734 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.221736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.222005 (+ 269us) server_negotiation.cc:407] Connection header received
0811 16:47:05.222102 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.222103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.222114 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.222143 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.222554 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57244: BlockingRecv error: recv got EOF from 127.0.0.1:57244 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 16:47:05.226609 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.225788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57258 (local address 127.27.186.125:46807)
0811 16:47:05.225826 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.225828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.226093 (+ 265us) server_negotiation.cc:407] Connection header received
0811 16:47:05.226192 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.226192 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.226204 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.226235 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.226559 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57258: BlockingRecv error: recv got EOF from 127.0.0.1:57258 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 16:47:05.232475 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.231690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57268 (local address 127.27.186.125:46807)
0811 16:47:05.231726 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.231728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.231979 (+ 251us) server_negotiation.cc:407] Connection header received
0811 16:47:05.232075 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.232076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.232086 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.232115 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.232427 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57268: BlockingRecv error: recv got EOF from 127.0.0.1:57268 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 16:47:05.242825 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.241763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45978 (local address 127.27.186.125:46807)
0811 16:47:05.241845 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.241847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.242167 (+ 320us) server_negotiation.cc:407] Connection header received
0811 16:47:05.242279 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.242280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.242292 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.242324 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.242769 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45978: BlockingRecv error: recv got EOF from 127.0.0.1:45978 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 16:47:05.265520 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.264415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45980 (local address 127.27.186.125:46807)
0811 16:47:05.264463 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.264465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.264822 (+ 357us) server_negotiation.cc:407] Connection header received
0811 16:47:05.264943 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.264944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.264958 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.264990 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.265432 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45980: BlockingRecv error: recv got EOF from 127.0.0.1:45980 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 16:47:05.300038 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.299034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45990 (local address 127.27.186.125:46807)
0811 16:47:05.299083 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.299085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.299411 (+ 326us) server_negotiation.cc:407] Connection header received
0811 16:47:05.299516 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.299517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.299530 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.299562 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.299972 (+ 410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45990: BlockingRecv error: recv got EOF from 127.0.0.1:45990 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 16:47:05.366405 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.365612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45998 (local address 127.27.186.125:46807)
0811 16:47:05.365686 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.365688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.365820 (+ 132us) server_negotiation.cc:407] Connection header received
0811 16:47:05.365872 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.365872 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.365885 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.365940 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.366309 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45998: BlockingRecv error: recv got EOF from 127.0.0.1:45998 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260811 16:47:05.496528 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.495742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46014 (local address 127.27.186.125:46807)
0811 16:47:05.495820 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.495823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.495955 (+ 132us) server_negotiation.cc:407] Connection header received
0811 16:47:05.496010 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.496011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.496022 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.496082 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.496451 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46014: BlockingRecv error: recv got EOF from 127.0.0.1:46014 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 16:47:05.754398 1446 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 16:47:05.753755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46030 (local address 127.27.186.125:46807)
0811 16:47:05.753811 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:05.753813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:05.753823 (+ 10us) server_negotiation.cc:407] Connection header received
0811 16:47:05.753870 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:05.753870 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:05.753880 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:05.753931 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 16:47:05.754310 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46030: BlockingRecv error: recv got EOF from 127.0.0.1:46030 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 16:47:06.110574 1597 catalog_manager.cc:1259] Loaded cluster ID: 0786cb12542543c598694fe5efeb0db9
I20260811 16:47:06.110651 1597 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64: loading cluster ID for follower catalog manager: success
I20260811 16:47:06.111459 1597 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64: acquiring CA information for follower catalog manager: success
I20260811 16:47:06.111752 1597 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e8ebe0056c9d486cbd1610eda485ee64: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:47:06.173561 1664 catalog_manager.cc:1259] Loaded cluster ID: 0786cb12542543c598694fe5efeb0db9
I20260811 16:47:06.173643 1664 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041: loading cluster ID for follower catalog manager: success
I20260811 16:47:06.174431 1664 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041: acquiring CA information for follower catalog manager: success
I20260811 16:47:06.174695 1664 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c4df507da0c54c6d90e285d93fd68041: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 16:47:06.270495 1794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:06.267581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46042 (local address 127.27.186.125:46807)
0811 16:47:06.267721 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:06.267724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:06.267792 (+ 68us) server_negotiation.cc:407] Connection header received
0811 16:47:06.267866 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:06.267867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:06.267957 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:06.268060 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:06.268227 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.268748 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.269597 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.269821 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.269902 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:06.270115 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:06.270241 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:06.270334 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:06.270374 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 16:47:06.270396 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260811 16:47:06.274950 1803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:06.272462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55790 (local address 127.27.186.124:45071)
0811 16:47:06.272599 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:06.272602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:06.272610 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:06.272659 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:06.272660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:06.272693 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:06.272782 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:06.272897 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.273372 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.274137 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.274345 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.274428 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:06.274595 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:06.274696 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:06.274781 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:06.274823 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 16:47:06.274844 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260811 16:47:06.279990 1794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:06.276873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46046 (local address 127.27.186.125:46807)
0811 16:47:06.276925 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:06.276927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:06.277115 (+ 188us) server_negotiation.cc:407] Connection header received
0811 16:47:06.277146 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:06.277148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:06.277159 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:06.277234 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:06.277359 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.278020 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.279064 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.279349 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.279413 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:06.279726 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:06.279762 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:06.279813 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:06.279868 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 16:47:06.279888 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 16:47:06.280120 1803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:06.277072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55804 (local address 127.27.186.124:45071)
0811 16:47:06.277119 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:06.277121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:06.277296 (+ 175us) server_negotiation.cc:407] Connection header received
0811 16:47:06.277324 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:06.277325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:06.277338 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:06.277405 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:06.277567 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.278279 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.279290 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.279574 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.279644 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:06.279834 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:06.279866 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:06.279915 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:06.280021 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 16:47:06.280051 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 16:47:06.280313 1813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 16:47:06.276985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53546 (local address 127.27.186.126:43517)
0811 16:47:06.277309 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0811 16:47:06.277311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 16:47:06.277319 (+ 8us) server_negotiation.cc:407] Connection header received
0811 16:47:06.277367 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 16:47:06.277368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 16:47:06.277421 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 16:47:06.277567 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 16:47:06.277729 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.278460 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.279295 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 16:47:06.279555 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 16:47:06.279635 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 16:47:06.279837 (+ 202us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 16:47:06.279947 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 16:47:06.280012 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 16:47:06.280189 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 16:47:06.280216 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":72,"threads_started":1}
I20260811 16:47:06.282334 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 1234
I20260811 16:47:06.294606 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 1345
I20260811 16:47:06.302449 28393 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJargcS/build/release/bin/kudu with pid 1450
2026-08-11T16:47:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3080 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6299 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (292379 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST